(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date 
19 December 2002 (19.12.2002) 




PCT 



11 



(10) International Publication Number 

wo 02/101513 A2 



(51) International Patent Classification^: G06F 

(21) International Application Number: PCT/US 02/1 8864 

(22) International Filing Date: 11 June 2002 (11.06.2002) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 
09/879,761 



1 2 June 2001 ( 1 2.06.2001 ) US 



(63) Related by continuation (CON) or continuation-in-part 
(CIP) to earlier application: 

US Not furnished (CIP) 

Filed on Not furnished 

(71) Applicant (for all designated States except US): INTER- 
NETCLASS COMMUNICATIONS, INC. [USAJS]; 814 
Elm Street, Suites 505-509, Manchester, NH 03101-2130 
(US). 

(72) Inventor; and 

(75) Inventor/Applicant (for US only)* BAHADIROGLU, 



Murat, h [—/US]; 49 Technology Drive, Unit 68, Bed- 
ford, NH 03110 (US). 

(74) Agents: CLAPP, Gary, D. et al.; Davis & Bujold, 
P.L.L.C., Fourth Floor, 500 North Commercial Street, 
Manchester, NH 03101 (US). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG. BR, BY, BZ, CA, CH, CN. CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, FI, GB, GD, GE, GH, 
GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, OM, PH, PL, PT, RO, RU, SD, SE, SG, 
SI, SK, SL, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, 
VN. YU, ZA, ZM, ZW. 

(84) Designated States (regional): ARIPO patent (GH. GM. 
KE, LS, MW, MZ, SD. SL, SZ, TZ, UG, ZM, ZW), 
Eurasian patent (AM. AZ, BY. KG, KZ, MD, RU, TJ, TM), 
European patent (AT, BE. CH, CY. DE, DK, ES, FI, FR, 
GB, GR, IE, rr, LU, MC, NL. PT, SE. TR), OAPI patent 
(BF, BJ, CF, CG, CI, CM. GA, GN, GQ, GW. ML. MR, 
NE. SN. TD, TG). 

[Continued on next page] 



(54) Title: ADAPTIVE CONTROL OF DATA PACKET SIZE IN NETWORKS 



< 
IT) 



o 




(57) Abstract: An adaptive packet mechanism and method for optimizing data packet transmission through a network connection 
between a sending node and a receiving node. Current network conditions in the connection are periodically determined wherein 
the network condition pertain to the latency and jitter of packet transmission between the sending node and receiving node. The 
measurements of latency and jitter are used to determine an optimum packet size and an optimum inter-packet interval for trans- 
mission of packet data between the sending node and tlic receiving node and are used in the transmission of data packets from the 
sending node to the receiving node. Network conditions may be determined by transmission of monitor or data packets and may be 
determined at either or both of the sending or receiving nodes and the optimum packet size and inter-packet interval are determined 
by a fuzzy logic analyzer, a neural network analyzer or a combined fuzzy/neural network analyzer. 



c^FST AVAILABLE COPY 



wo 02/101513 A2 lilllilllilllliillllllllilllliilllilDllllii 



Published: For two-letter codes and other abbreviations, refer to the "Guid- 

— without international search report and to be republished ance Notes on Codes and Abbreviations" appearing at the begin- 
upon receipt of that report ning of each regular issue of the PCT Gazette. 



wo 02/101513 PCT/US02/18864 



[001]ADAPT1VE CONTROL OF DATA PACKET SIZE IN NETWORKS 
[002] CROSS REFERENCES TO RELATED APPLICATIONS 

[003] The present application is related to and a continuation in part of co-pending 

parent U.S. Patent Application Serial No. 09/879,761 filed 12 June 2001 by Murat I. 
Bahadiroglu for ADAPTIVE CONTROL OF DATA PACKET SIZE IN NETWORKSand 
assigned to the same assignee as the present application. 

[004] FIELD OF THE INVENTION 

[005] , The present invention is directed to a method and system for transmission of data 
through a network and, in particular, to a method and system for the transmission of data 
through a network wherein data packet size is adapted to network conditions to enhance 
the data transmission rate to meet predetermined requirements of data transmission. 

[006] BACKGROUND OF THE INVENTION 

[007]. Networks have long been commonly used to communicate information of all forms 

between various computer systems, such as program code and data, including audio, 
graphic and video or graphic information. As a result, computer systems and 
communications systems have evolved together, each influencing the other and each 
evolving to address methods and problems presented by the other. 

[008] For example, telephone networks, long being in existence as a widely available 

means of communicating information from one point to another when computers were 
first developed, were one of the first forms of network used for communication between 
computer systems. The inherent characteristics of the original telephone networks 
thereby, as a consequence, defined the original computer cornmunication methods and 
technologies. As is well known and understood, telephone networks allow 
communication of audio data, or more broadly audio signals, between two or more users 
by establishing a dedicated communication circuit or "channel" between the users 
through one or more central switching systems. As is also well known and understood, 
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information in a computer system is structured as units or packets of multiple bits or 
bytes of predetermined size and, as a consequence, various methods and signal formats 
were developed to communicate digital information packets tlirough the telephone 
networks. 

[0091 The essential nature of the original telephone networks is such that a channel, 

once established, is dedicated exclusively to a single information exchange, whether the 
information is a conversation between user's or digital information being communicated 

. between one computer and another. Dedicated channels are advantageous in that the 
. entire bandwidth of the channel is available for a given information exchange and in that 
any transmission delays from an information source to an information recipient are purely 
a function of the direct transmission speed through the channel. Since dedicated channel 
transmission speed does not significantly vary over time or with the information 
transmission load, dedicated channels are capable of providing "isochronous" 
transmission. A significant disadvantage of dedicated channels, however, is that 

. dedicated channels preempt significant bandwidth of the communications network. That 
is, the complete bandwidth of a channel is and remains available and dedicated to a 

- given link between computer systems, even when the information exchange does not 
require the full bandwidth of the channel and even when no information is being 
transmitted. 

[010] For the above reasons, dedicated channels have been inadequate to meet the 

needs of intercomputer communication as information exchange between computer 
systems has become more common and widespread. As a consequence, telephone 
systems and computer communication methods have evolved to meet to the increased 
demand for information exchange between computers, and have generally evolved in 
conjunction to meet common needs, in particular the transmission of data, and to make 
advantageous use of jointly developing technologies. 

[01 1] For example, various forms of networks have been developed that are dedicated 

to or specifically adapted to communication between computers. Networks specifically 
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oriented to intercomputer communications typically provide individual computers shared 
access to a common communication bacl^bone having relatively broad bandwidth, such 
as fiber optic cables or coaxial or twisted pair cable. The individual networked computers, 
commonly referred to as "nodes", are typically granted access to the complete bandwidth 
of the backbone for the transmission of each information packet for a period, and when 
a transmitting computer completes transmission of a packet the backbone Is made 
immediately available for the other computers or nodes connected to the network. Each 
computer thereby has access to the full bandwidth of the network, but only during the 
actual transmission of a packet, so that many computers may efficiently share the 
common "backbone". A typical example of such a computer network is a personal 
computer ("PC") network as PCs are used fdr a wide range of applications requiring the 
PCs to communicate with each other over a computer network. Typical computer 
networks connecting PCs. as well as other computers, nodes and related devices and 
systems, include local area networks ("LANs") interconnecting PCs located in relatively 
close proximity and wide area networks ("WANs"), which are typically comprised of a 
network of separate LANS and provide communications over wider areas. The "Web", 
for example, is a very extensive WAN interconnecting LANs as well as PCs, larger 
computers, nodes and related devices. 
[012] Telephone networks in various forms, however, remain the most common method 

for interconnection and communication between computers. For example, telephone 
networks are frequently employed as a WANs linking individual computers or LANs and 
the World Wide Web is primarily based upon telephone networks. Many telephone 
systems are presently implemented with broadband channels, such as fiber optic lines, 
to provide increased numbers of channels or increased channel bandwidths for the 
transmission of computer data and digitized voice signals. As a consequence, there have 
been extensive efforts to establish interface standards, methods and technologies for the 
faster and more efficient transmission of digital information packets through the various 
implementations of telephone networks. For example, many telephone systems are now 
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impiemented using computer network technologies, such as broadband backbones, and 
many telephone networks also digitize audio Information, that is, voice signals, into digital 
data packets analogous to computer data packets. The adaptation of computer network 
technologies to telephone networks thereby allows voice information to be 
communicated in a manner analogous to computer information packets by concurrent 
communication of multiple channels on a single line and the routing of digitized voice 
packets through multiple pathis. The adaptation of computer originated technology and 
methods to telephone systems and voice communications thereby allow telephone 
networks to carry both voice information and computer information with equal facility. The 
consequences of such developments in telephone systems may be seen, for example, 
in the implementation and rapid expansion of Work Wide Web communications between 
computers, which is primarily implemented through the telephone networks. 
[013] The development of the hardware technologies of telephone networks and of 

computer specific networks has been paralleled by the development of standards and 
protocols for the more efficient transmission of data packets through computer networks. 
In this regard, the heart of any computer network, whether based upon a telephone 
network or implemented as a network dedicated to or specifically adapted to 
communication between computers, is a communication protocol wherein a 
communications protocol is a set of conventions or rules that govern the transfer of data 
between computer devices. The simplest protocols define only a hardware configuration, 
while more complex protocols define timing, data formats, error detection and correction 
techniques and software structures: Virtually all forms of computer networks commonly 
employ multiple layers of protocols wherein each layer of the protocols defines and 
controls a corresponding level of operations in the communication between conriputers 
through the network. For example, the physical protocol layer typically defme and control 
the lowest level of operations and will commonly include a low-level physical or device 
layer protocol that assures the transmission and reception of a data stream between two 
devices, while a higher level data link protocol layer defines and manages the 
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constructlon and transmission of data packets. Network and transport layer protocols, 
such as the Transmission Control Protocol/internet Protocol ("TCP/IP"), operate a higher 
levels than the physical layer protocols, and in turn govem the transmission of data 
through the network itself, thereby ensuring the reliable end-to end delivery of the data 
packets defined at the lower levels. 
[014] There are presently a range of industry standard protocols for the efficient 

transmission of data through both computer specific networks and telephone networks, 
most of which are based upon the packet transmission of data. Examples of existing 
standards and protocols for the transmission of computer data through networks, 
including telephone networks and computer specific networks, include the Integrated 
Services Digital Network ("ISDN"), which standardizes connection interfaces, 
transmission protocols and services to create a unified digital circuit-switching network. 

. A further example is Broadband ISDN ("BISDN") which, unlike ISDN which is a digital 
network standard, uses packet relay, or Asynchronous Transfer Mode ("ATM"), as a 
transmission standard, particularly for transmission over broadband "backbones". ATM 
is primarily a connection-oriented technique that can transport both connection and 

. connectionless- oriented services at either a constant bit rate or a variable bit rate. ATM 
provides bandwidth on demand and handles all traffic types through fast-packet 
switching techniques that reduce the processing of protocols and uses statistical 
multiplexing, to control transmission through the network. 
. [015] It has long been commonly recognized and understood, however, that. a primary 

limitation upon the communication of data through networks is that the bandwidth 
resources available in any network are limited. Other, related problems include network 
latency and jitter, which are delays in end-to-end data transmissions arising from a 
variety of causes. The "latency" of a network includes the inherent delay times through 
the elements of the network, such as through the cables or lines, the switching routers 
and the communications processes or protocols being executed at each end of the 
connection. Although the latency of a network tends to be relatively constant for a given 
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<x)nnection, latency may vary from connection to connection, depending upon the 
particular route taken through a network by a given connection and upon the traffic load 
of the network or in the route defined for the connection. The latency of a network effects 
the overall efficiency and effective bandwidth or capacity of a network by imposing a 
practical limit on the rate at which data, and in particular packet data, can be 
communicated through the network, particularly since many protocols require an 
acknowledgment of each packet before a next packet is transmitted. "Jitter", in turn, may 
be defined as change in network latency as a function of time. Jitter is typically 
unpredictable and may arise from a number of causes, but most frequently results from 
variations in the traffic load along the route taken by a connection through a network. As 
such, the "jitter" of a network connection may vary significantly from packet to packet and 
even more so in systems that allow independent routing of individual packets. Jitter also 
effects the overall efficiency and effective bandwidth or capacity of a network by 
imposing a practical limit on the rate at which data can be communicated through the 
network, and has particulariy adverse effects in asynchronous networks, such as many 
computer networks and networks employing, for example, the ATM protocol. 
[016] It has long been understood that efficient bandwidth and traffic management is 

essential to obtain full advantage of the bandwidth and capacity of a network and 
significant efforts have been made in designing traffic flow and congestion control 
processes, bandwidth management mechanisms and routing algorithms to manage 
available network bandwidth and capacity. The goal of such developments has been a 
network that is able to transmit a useful level of traffic that is directly proportional to the 
traffic offered to the network up to the maximum transmission capacity of the network, 
and thereafter to continue to operate at the maximum network capacity regardless of the 
imposed traffic load. The actual performance achieved in networks falls far short of these 
goals, however, for reasons pertaining to practical constraints in implementing networks 
and arising from limitations inherent in the methods presently used to manage networks. 
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[017] For example, the simplest method for obtaining satisfactory performance in a 

network is to oversize the equipment, that is, the number and capacity of the channels 
and the traffic capacity of the routing switches, so that in all anticipated operating 
conditions the network will be operating in a zone that is well distant from congested 
levels or zones of operation. This method, however, Is generally unsatisfactory because 
of cost and because the traffic demands on networks historically increases rapidly over 
time to exceed the anticipated maximum loads on the networks, . thus resulting In 
eventual congestion regardless of the initial capacity of a network. 

[018] The preferred methods for obtaining satisfactory performance in networks have 

thereby focused on traffic management methods for managing and controlling the traffic 
load and flow in a network, mechanisms for allocating network bandwidth and 
improvements in protocols for the efficient transmission of data. Traffic flow and control 
measures, for example, typically include flow control for regulating the packet 
transmission rate of a transmitting system to a rate compatible with the rate the receiving 
system can absorb. Load regulation mechanisms, in turn, globally limit the number of 
. packets present at any time in the network to thereby avoid overloading the capacity of 
. the channels and routing switches while load balancing mechanisms distribute traffic 
over the links of the network to avoid local congestion. 

[019] A traffic management system, bandwidth allocation mechanism or 

. communications protocol, however, must be structured to meet requirements arising 
from the characteristics of network traffic which are difficult to accommodate. For 
example, network traffic is typically not well behaved, that is, the traffic load may vary 
widely and at unpredictable times or under unpredictable circumstances, and often . 
departs substantially from the initially assumed traffic parameters. If such a departure 
persists, the traffic management system must, for example, assign one or more new 
connection bandwidths to one or more connections to accommodate the new traffic 
parameters, which in turn may affect yet other connections and require adaptations or 
modifications of those connections, and so on. Determining the appropriate responses 
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of the traffic management system to radical changes in traffic behavior in turn presents 
yet further problems. Typical problems are those of obtaining and filtering traffic load 
measurements to separate transient changes of traffic behavior from longer term 
changes and determining ranges within which the initially assumed traffic parameters 
can be maintained and outside of which new connection bandwidths must be requested. 
For example, a bandwidth that is too large for the actual traffic is wasteful of connection 
resources while a bandwidth that is too small results in excessive packet loss. 
Continuous adjustments of channel bandwidths to meet transient conditions, however, 
absorb excessive network resources in continuous adaptation to conditions that rhay 
have clianged by the time the adaptations take effect. 
[020] • Another source of network problems arises when the communications protocols 
implemented in a given network for efficient data transmission conflict with the operation 
of the network traffic management system.. This problem arises, for example, from 
conflicting goals when the traffic manager operates to optimize the overall performance 
of the network while the protocols executed in the network users attempt to optimize the 
performance of each user of the network individually. For example, it has been described 
above that TCP/IP is a very commonly used protocol. TCP/IP, however, employs a "go 
back N method" for dealing with errors and flow control problems over a network. If there 
is a transmission error, a packet loss, excessive latency in the delivery of a packet, 
. delivery of a packet out of sequence or an overflow of a receiver buffer, the protocol 
retransmits N preceding piackets. The retransmission of packets by TCP/IP in response 
. to problems that may arise from traffic congestion may thereby significantly increase the 
traffic load congestion that the network management system is attempting to address. 
This problem may become particularly severe if the TCP/IP protocols of several users 
are retransmitting packets in response to data communications problems arising from 
traffic congestion rather than from circumstances in the individual transmitters or 
recipients. 
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[021] To Illustrate the above by considering various mechanisms of the protocols and 

networl< management mechanisms of the prior art in greater detail, many protocols such 
as TCP/IP implement packet priority mechanisms to prevent saturation of a network. A 
"leaky bucket" algorithm, for example, limits the number of low priority packets that can 
be transmitted in a fixed period of time when the packets digress from an original rate 
of transmission, so that high priority traffic is thereby transmitted with little or no delay. 
A leaky bucket or similar packet priority mechanism will thereby maintain packet 
transmission at acceptable levels if the traffic is not unreasonable and if the traffic 
remains within a reasonable range of the initial transmission parameters. Network traffic 
loads, however, are often unreasonable and often depart substantially from the initial 
transmission parameters, thereby requiring other mechanisms to accommodate changes 
in the traffic loads. 

[022] For example, if a departure from the initial traffic parameters in a given connection 

persists for a significant length of time, a traffic control system will typically assign a new 
connection bandwidth to the connection to accommodate the new traffic parameters. 
This mechanism, however, must adapt both to radical changes in traffic behavior and the 
problem of short-lived changes in traffic behavior as opposed to long term changes and 
must determine which connection bandwidths would be suitable to traffic behavior at a 
: given time. Too large a bandwidth would waste connection resources and a too small a 
bandwidth would result in packet loss. 

[023] The problem of detiermining appropriate connection bandwidths may be illustrated 

. by consideration of the problems of latency, jitter and "burst" type data. That is, and for 
example, if packets are being transmitted through a connection with no losses and the 
predefined maximum window size is appropriate, wherein window size may be 
considered as connection bandwidth and the time interval assigned for transmission to 
a given system, the steady flow of transmission data will bring the TCP protocol to a 
steady state. In this steady state, one new packet of data is placed on the network for 
transmission each time an acknowledgment of receipt of the previous packet is received 
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from the receiving end node of the connection by the sending end node of the 
. connection. The time lapse between each packet transmission is thereby determined by 
the rate at which acknowledgments arrive at the sending end node. If network bandwidth 
and latency remain consistent, packets flow freely and few packets are lost to buffer 
overflows, such as in routers. However, and as discussed above, many networks are 
subject to long term changes in connection bandwidth, as when bandwidth is reassigned 
due to changing traffic conditions, and long and short term variations in latency, including 
Jitter due, for example, to short term traffic conditions. Variations in bandwidth 
requirements may also arise from the nature of the data being transmitted. For example, 
video and voice data typically appears as data "clusters" interspersed with large gaps. 
As a consequence, the voice or video data clusters are typically transmitted in "bursts" 
and as a result a protocol such as TCP/IP does not make efficient use of the bandwidth 
available between bursts. 

[024] A traffic control system typically adapts to changes in traffic parameters by 

defining the regions of the network where bandwidth allocations do and do not require 
adjustment to meet traffic n^eds. Bandwidth allocations are adjusted upward if 
measurements indicate the anticipated maximum acceptable packet loss will be 
exceeded or that traffic on the connection will interfere with other connections sharing 
the transmission medium. Bandwidth requirement is adjusted downward if the quality of 
service will be acceptable for alj users. 

[025] To determine the required bandwidth adaptations, a traffic control system will take 

measurements of the mean burst duration and mean bit rates and will filter the 
measurements to insure that a statistically reliable number of raw measurements have 
been obtained. The minimum required number of raw measurements and the mean bit 
rate of the traffic will determine the time required to collect the raw measurements. This 
measurement time, in turn, may used to analyze statistics of the incoming data stream 
to, for example, a leaky bucket mechanism and to determine the effect of the leaky 
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bucket on incoming traffic. This effect may then be .used to predict how the leaky bucket 
is monitoring the transmission, and to determine packet loss probability. 

[026] When traffic parameters fall outside of the acceptable bandwidth adaptation 

range, a traffic control system will request a new connection with a different bandwidth. 
Typically, however, the adaptation mechanism requires a longer time to adapt to upward 
changes in the traffic parameters, that is. to increases in traffic load or speed, due to the 
time lag in the measurement and filtration process. This, in tum, often results in 
overcompensation in upward or downward network bandwidth adjustments and either 
inefficient use of network resources or degradation of data transmission or both. This 
problem further compounded in that it is common to have a single processor monitoring 
and performing traffic control fuhctionis for several connections, so that the bandwidth 
adaptation functions are limited by inadequate processing capabilities. 

[027] Many protocols and network management systems also perform "windowing" of 

network resources, that is, the allocation of transmission periods and bandwidths to 
systems for communication through the network and the adjustment of the windows as 
traffic needs change. The performance of a TCP/IP monitored transmission, for example, 
depends heavily on the value is determined for the threshold for window growth, that is, 
the speed with which a window may be increased, and the maximum window size. If a 
window size is too small or the threshold is too low, the TCP/IP will not be able to transfer 
sufficient data for optimum performance and, if the prescribed window size is too large, 
TCP/IP may lose packets or network congestion may ensue, or both. 

[028] For example, under some conditions a current window size may grow to a 

maximum window size that may exceed the window size optimal for the link and such an 
oversize window may allow TCP/IP to transmit excessive numbers of packets. The 
superfluous packets may exceed the optimal number of packets for the available 
bandwidth and buffer space available at nodes between the sending and receiving end 
nodes of the connection, thereby overloading the system. 
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[029] Yet other problems occurs in the handling of packet dropping under the TCP/IP 

protocol when excessive packets are transmitted. For example, if the slowest 
intermediate node between a sending end node and a receiving node of a network 
connection has Insufficient buffer space to hold the surplus packets, the packets will be 
dropped. The dropping of packets will result in TCP/IP initiating a time-out and the 
retransmission of packets. Depending on the version of TCP/IP, the protocol will either 
reduce the window size by half or restart with the original window size for each dropped 
packet. Under these conditions, this response by TCP/IP will initiate a repeated cycle 
wherein TCP/IP will increase the window size, surplus packets will be transmitted, a 
packet will be dripped due to insufficient buffer capacity, and the window size will be 
reduced, and so oh, which will result in a severe reduction in packet throughput. 

[030] In the circumstance wherein the slowest intermediate. node does have enough 

buffer space to hold extra packets, packets will not be dropped initially. However, 
subsequent packets will be continuously transmitted by other nodes on the network and . 
the rate of transfer of packets will become progressively slower through the nearly 
saturated buffer. At some point the network will become congested and the buffer will 
eventually no longer be able to store additional packets. Papkets will then be dropped, 
and the above described cycle will begin. 

[031] Yet further problems of the methods of the prior art arise in that the performance 

of protocols using windowing, such as TCP/IP, depend significantly upon altering window 
size. In TCP/IP, for example, the window size is set ait one when there is no data being 
sent across the network and when packets begin to flow on the network TCP/IP starts 
increasing the window size towards the predefined maximum. If the current window size 
is near or at maximum when new data is transmitted, the packets will be placed on the 
network in rapid succession until all the packets are sent, whereupon the window size 
will be reset to one as there are no further packets to be transmitted. This process, 
however, may result in a number of undesired consequences. For example, the rapid 
transmission of packets when the window size is near or at maximum comprises a "burst" 



wo 02/101513 



PCT/US02/18864 



-13- 

of packets, as described above, that may be a cause for network congestion. As a 
further consequence, due to the network congestion resulting from such a burst of 
packets, the packets transmitted at the end of the burst may be dropped because of 
network congestion and/or buffer overflow. In addition, and when data is transmitted 
intermittently, as in successive, separated blocks, the window size may be reset to one 
at the end of each block of transmitted data. The window size will thereby start at one 
for each new block of data, so that TCP/IP is prevented from fully utilizing the available 
bandwidth, 

[032] Problems may also arise from the operation of routers, which transfer information 

. from network to network and perform conversion operations at the physical and network 
layer of protocols in doing so. In particular, the physical Layer 28 typically includes a 
media access layer (MAC) that specifies the maximum transmission unit (MTU) that can . 
be transmitted over the physical medium wherein the MTU is defined and described as 
. a maximum number of transmission units a network segment is capable of transmitting: 
. . An MTU is thereby essentially the maximum size of data block or data unit^ sometimes 
referred to as a segment, that can be conveyed through the physical medium of the 
network and will depend upon the physical characteristics of the network, the router and 
the protocol. Because of MTU limitations, therefore, a router is often required to convert 
a packet into small units, generally referred to as "fragments", in order to transfer the 
packet through a network. 

[033] In particular, MTU complications may arise during the transmission of a packet, 

. often referred to as a diatagram, through a connectionless network. In a connectionless 
network, no connection information is assigned to a packet as it travels between the 
nodes of the network and the packet Instead contains only information identifying the end 
node destination of the packet. As such, and as an intended consequence, each packet 
will typically and often travel over a different path of one or more networks or routes 
through one or more networks to arrive at the destination node. As the datagram travels 
from the sending node to the destination node, it is typically fragmented by various 
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amounts to conform to the MTU of each Intermediary network. Routers in connectionless 
networks, such as the Internet, thereby require increased processing power to fragment 
large segments into smaller segments, thereby Increasing transmission overhead and 
processing time during the transmission of a datagram. In addition, the destination host 
is required to expend an increased amount of processing resources and time to buffer 
a potientially large cache of segments and to reassemble the segments into the original 
message. These, requirements increase the latency of the network, and jitter due to the 
different transmission times of the fragments, while the increased the amount of packet 
header information that must be transmitted because of fragmentation effectively 
reduces the effective network bandwidth. 

[034] . If a datagram travels over a route with an inherently large MTU, it may not be 
necessary to fragment the packet. Hpwever, when fragmenting is required, it may be 
difficult to control on a connectionless network because each segment may travel over 
a different route. Also, if a route of a network fails or is incorrectly configured, the network 
properties may change so that segments may be sent over a route with a smaller MTU, 
thereby requiring more extensive fragmentation. As a consequence, the routing of the 

. segments or fragments of a datagram may become extremely complex, and it is difficult 
for a transmitting host to select an appropriate datagram size that will minimize 
fragmentation. As a result, current techniques for selecting datagram sizes to reduce 
overall fragmentation while maintaining an optimum bandwidth have not been 
successful. 

[035] In yet other methods of the prior art for network management, the transport Layers 

28 of certain protocols may use a "packet metering" protocol instead of a window sizing 
protocol. As described, window sizing allows one new packet of data to be placed on the 
network for transmission each time an acknowledgment of the receipt of a preceding 
packet is received by the sending end node. In contrast, packet metering limits the rate 
at which packets are placed on the network by instructing the sending end node to send 
the packets at a selected rate if the network is not congested. In packet metering 
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systems the packet metering rate is set during the initial system configuration and 
remains fixed thereafter while in other systems the metering rate is adapted to changing 
network conditions. 

[036] Window sizing and packet metering have relative advantages and disadvantages. 

For example, when the packet-metering rate is set appropriately, packet metering avoids 
the bursts resulting in window sizing systems from intermittent data transmission. Also, 
optimal packet metering results in the transmission of data at a rate that does not cause 
congestion or packet dropping while making optimum use of the available bandwidth. 

[037] In comparison, window sizing avoids congestion but uses bandwidth inefficiently 

by reducing the window size after each block of data that is transmitted. An advantage 
of window sizing as opposed to packet metering, however, is that window sizing tends 
to provide better limits on the numtier of additional packets that are transmitted after 
packets are dropped by halting transmission of packets immediately If an expected 
acknowledgment is not received. In contrast, packet metering depends on packet rate 
; measurements that are taken after two or more packets are sent, so that the mechanism 
. responds more slowly to missing acknowledgments. In one packet metering system, for 
example, the rate at which packets arrive at the receiving end node and the rate at which 
they are removed from the receiving end node's buffer for processing is transmitted to 
the sending end node and extra packiets will continue to be placed on the network during 
the measurement and rate information transmission interval. 

[038] A recurring and severe problem with window sizing, packet metering and similar 

systems and protocols, however, is that such systems and methods require accurate 
. information regarding network parameters and careful choice of adaptive parameters to 
be effective. Many such mechanisms, for example, are statically configured with 
parameters such as a maximum window size, a start widow growth threshold, ranges 
for separating rapid window growth from slower window growth, or default packet- 
metering rates. Networks, however, and in particular networks of any extent and 
especially connectionless networks such as the Internet are so complex that it is 
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extremely difficult to determine the optimum operating parameters for such mechanisms. 
The problem is further compounded by variations and changes in network parameters, 
such as traffic load and the changing conditions through various links or connections of 
a network. 

[039] The above discussed problems of the method and mechanisms of the prior art for 

the management and operation of networks are further compounded by more recent 
developments in network technologies and developing applications for networks, such 
as the transmission of video data. 

[040] For example, Internet applications across wireless networks are rapidly becoming 

common and are carrying rapidly increasing volumes of data traffic of all forms, so that 
the reliable performance of data communications in mobile environments is becoming 
a vital issue. The methods and mechanisms of the prior art for managing network data 
• communications, however, are essentially based upon prior wired network models and 
are often inadequate for new network technologies, such as mobile, wireless networks 
and may often actual degrade the operation of such networks. 

[041] To illustrate, delays and packet losses in a wireless environment are often caused 

by problems that are not related to network congestion, such as communication pauses 
during handoffs between wireless cells, packet losses of a mobile node moves out of 
range of the base stations, and packet losses due to transmission errors on wireless 
linkis. A protocol such as TCP/IP, however, may interpret such delays and packet losses, 
as an indication of network congestion. As described above, TCP/IP will respond to 
packet losses by assuming network congestion, retransmitting the apparent lost packets 
and initiating congestion control procedures. Such procedures include or may include 
reduction of the transmission window size, restriction of the window growth rate, and 
resetting a retransmission timer to a back-off interval that doubles with each consecutive 
tinieout. As a consequence, and even though wireless networks typically contain 
mechanisms to indicate network changes such as handoffs between cells, such 
mechanisms often may not respond in time to prevent the initiation of TCP/IP network 
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congestion procedures. TCP/IP will thereby frequently respond inappropriately to a short 
term wireless network problem that is particular to mobile, wireless networks, thereby 
degrading the network performance. 

[042] It must be noted that wireless networks are subject to still further problems than 

those resulting from node motion, such as packet losses due to physical transmission 
errors, incorrect positioning of antennas, ambient noise, multipath interference and other 
factors. Again, however, and because the network management mechanisms and 
protocols of the prior art are essentially designed for wired networks, presently existing 
mechanisms and protocols will frequently respond inappropriately to problems that are 
particular to wireless networks or other new network technologies. 

[043] In addition, the above discussed problems have inhibited and delayed the use of 

networks for the communication of certain types of data, commonly referred to as 
multimedia data, and in particular the communication of multimedia data through a 
telephone type network between computers or from computers to other types of 
recipients and. Multimedia data is commonly understood and defined as including all 
forms of data, including packeted data, representing digitized audio and video signals, 
such as music, voice and ianimated graphics, that is, "movies". The goal of much current 
development effort in these areas Is, for example, to allow the use of a computer network 
to carry telephone type voice communications as well as traditional computer data and 
to eventually allow the transmission and distribution of, for example, music, "videos" and 
"movies". 

[044] In this regard, it should be noted that computer data is traditionally regarded as 

"bursty", that is, as existing in the form of defined blocks or units and thereby appropriate 
for transmission through a network in the form of data "packets". This traditional view or 
conception of computer data arises, of course, from the inherent structure of digital data 
in a digital computer into units of one or more bits, bytes and words. The structure of 
data in a computer, however, arises from the internal physical structure of the data 
handling components of a computer, that is, the registers, buffers, busses and so on of 
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a digital computer, are physically designed to store data as discrete bits. It should be 
noted, however, that data may be and often is transmitted through a network as an 
effectively continuous stream of bits, once a connection is established, as well as in 
pacl<ets. 

[045] In contrast, multimedia data, that is, audio and video data, is often regarded or 

conceived as being inherently "continuous" rather than "bursty". This view of multimedia 
data, however, is not entirely correct and to some extent masks the actual problems of 

. communicating multimedia data through networks. For example, the spoken words of 
voice communications appear to be comprised of discrete units or utterances, that is. 
syllables or words, while music appears to be comprised of discrete clusters or 
sequences of notes. The Upon closer consideration, however, it will be realized that 
audio data, whether voice or music, is a continuous sequence of units of extremely 
variable size and duration but is effectively a continuous flow of information. The primary 
distinction between audio data and traditional computer data, therefore, is that traditional 

• computer data is and may be organized and transmitted as discontinuous packets while 
audio data, whether voice of music, is a continuous data stream. It must be noted, 
however, that all forms of audio data can be and often are . digitized into traditional 
computer digital data forms, that is, bytes and words, and stored and delivered to a user 

. in the forms of computer data, with perhaps the additional step of a digital to analog 
conversion. In a like manner, video data of all forms is commonly digitized, stored and 
delivered to an output device as digital data and, in many instances, is generated and 
' inherently exists in "packeted" form, such as the lines and frames of television signals 
and the outputs of video drivers in computers. As such, it will be readily apparent that 
while audio/video information is inherently continuous in form, audio/video data can be 
and is readily represented In traditional digital form, that is, as "packets" of digital data, 

; and thus would reasonably thought to be suitable for transmission through networks in 
the same manner as digital computer data. 
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[046] A significant distinction between audio/video multimedia data and traditional fomns 

of computer data, and a primary cause of current problems in communicating multimedia 
data through networks such as telephone network, however, is the sensitivity of 
multimedia data to "jitter", which has been defined above as time dependent changes 
in network latency. That is, traditional fomris of computer data that are commonly 
communicated through networks, including telephone based networks, are commonly 
either used only after the entire body of data has been received or are otherwise used 
in a manner wherein the network latiency and jitter either are not apparent or are not a 
problem to the user. As such, the primary considerations in communicating traditional 
forms of computer data through a network are reliability of transmission and speed of 
transmission and the traditional forms of computer data are relative indifferent to jitter. 

[047] In contrast, the human eye and ear are extremely sensitive to minute shifts or 

variations in tones and inflections and pauses in audio data, whether, for example, voice 
of music, and to pauses or variations in rate in the presentation of video data. As a 
consequence, audio/video multimedia data, and in particular the real time transmission 
■and presentation of audio/video multimedia data, is extremely sensitive to jitter and may 
be very adversely effected by network latency. As such, the networks and protocols used 
to comniunicate multimedia audio and video data must, for example, compensate for or 
otherwise eliminiate the problems resulting from the latencies present in a communication 
network, including those relating to coding, packet assembly, media access, packet 
propagation, receiver buffering and decoding, and jitter in any or all of these operations. 

[048] In recent years, there have been a number of attempts to produce a digital data 

network, including telephone networks, capable of communicating multimedia data 
representing digitized audio and video signals and thereby functioning not only as a 
computer data network but as a multimedia network and as a telephone network. As 
discussed above, however, multimedia audio and video signals are extremely time and 
jitter sensitive and, while present networks and transport protocols are generally 
adequate for the transmission of traditional forms of computer data, such networks and 
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protocols have proven inadequate for the satisfactory communication of multimedia 
audio and video data. 

[049] In summary, ttnerefore, the methods and mechanisms of the prior art for managing 

networks and the communication of data through networks contain a number of 
problems. For example, the methods and mechanisms of the prior art attempt to 
determine and control traffic conditions within a network or connection by observation of 
factors that are external to the network or connection and that may be only indirectly 
related to nebwork conditions, or not related to network conditions at all. For example, 
observations regarding packet dropping rate or packet retransmission rate at a sending 

. node are only indirectly related to such factors as bandwidth limitations or buffer 
congestion and may not be at all related to bandwidth limitations or buffer congestion. 
The problems Inherent in the processes of the prior art are further compounded in that 
the processes for determining conditions within a network or connection are typically 
based upon assumptions about conditions within a network or condition that are often 
invalid. For example, packet dropping rate or packet retransmission rate are assumed 
to reflect network conditions, such as bandwidth limitations or buffer congestion due to 
. . a too high packet transmission rate, but may in fact arise from interference by other 
traffic or data processing errors or limitations at the receiving node. As a result, the 

./factors observed to determine conditions within a network or connection, the 
assumptions drawn from these factors and the resulting adaptive processes often have 
no relationship to actual conditions and problems in a network or connection, and often 
may, in fact, degrade the transmission of data. 
[050] Yet other problems of the prior art is that the methods and mechanisms 

implemented to manage traffic and data transmission in a network or connection may, 

. in fact, conflict with one another or with the basic nature of the data being transmitted or 
the nature of the connection. For example, the adaptations made by a protocol of one 
sending end node may compete with and conflict with those made by the protocols of 
other sending end node. In further example, many of the standard protocols and 
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mechanisms are ill adapted to certain types of data, such as "bursty" data, and the 
responses of the protocols and mechanisms of the prior art to such data may, in fact, 
degrade the transmission of such data. In other instances, and for the same reasons, the 
methods and mechanisms of the prior art often conflict with or do not readily adapt to the 
inherent characteristics of new network technologies, such as wireless connections, and 
often degrade or conflict with the transmission of data across such non-traditional types 
of connections. In yet other instances, the protocols and mechanisms of the prior art do 
not address the needs of new applications for the transmission of data. For example, the 
methods and mechanisms of the prior art often operate to maximize data transmission 
rate or to minimize packet dropping or packet retransmission and may fall to address the 
jitter problems are significant in audio/video transmission. 

[051] The present invention addresses and provides a solution for these and other 

related problems of the prior art. 

r0521 SUMMARY OF THE INVENTION 

[053] The present invention is directed to an adaptive packet mechanism and method 

for use In a data communication network including at least one sending node for 
transmitting packet data and one receiving node for receiving packet data for optimizing . 
data packet transmission through a connection between the sending node and the 
receiving node. 

[054] According to the present invention, the current network conditions in the 

connection between the sending node and the receiving node are periodically 
determined wherein the network conditions pertain to the latency and jitter of packet 
transmission between the sending node and receiving node. The measurements of the 
latency and jitter of the connection are then used to determine an optimum packet size 
and ah optimum inter-packet interval for transmission of packet data between the 
sending node and the receiving node. The amount and type of data to be transmitted 
from the sending node to the receiving node are also considered in determining the 
optimum packet size and the optimum inter-packet interval. The method and mechanism 
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Of the present invention may be employed for the transmission of data paclcets from the 
sending node to the receiving node with pacl^et sizes and at inter-pacl<et intervals 
determined according to the network conditions. 

[055] In a first aspect and implementation of the invention, the adaptive pacl<et 

mechanism transmits a sequence of monitor packets from the sending node to the 
receiving node wherein each monitor packet includes a departure time representing a 
time the monitor packet was transmitted from the sending node, a packet size 
representing a size of the monitor packet and a packet number representing a numerical 
position of the monitor packet in the sequence of monitor packets. The receiving node 
reflects the monitor packets from the receiving node to the sending node' in the sequence 
In which the monitor packets are received at the sending node, and the sending node, 
upon receiving the reflected monitor packets from the receiving node, determines 
network conditions in the connection between the sending node and the receiving node 
wherein the network conditions pertain to the latency and jitter of packet transmission 
between the sending node and receiving node for monitor packets of a known size and 
known inter-packet transmission interval. 

[056] In one implementation of the present invention the network conditions determined • 

through the rtionitor packets include a maximum two way delay time for the transmission 
and reflection of a monitor packet, a minimum two way delay time for the transmission 
and reflection of a monitor packet, an average two way delay time for the monitor 
packets, an average jitter of the monitor packets, and a number of packets out of 
sequence. In further implementations of the present invention, the network conditions 
determined through the monitor packets further include a number of packets lost. In still 
further implementations of the present invention, the network conditions determined 
through the monitor packets further include an average available bandwidth, an average 
jitter, a maximum jitter and a minimum jitter. 

[057] According to a first aspect of the present invention, the network conditions are 

determined by transmitting a sequence of monitor packets from the sending node to the 
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receiving node, each monitor packet including a departure time representing a time the 
monitor packet was transmitted from the sending node, a packet size representing a size 
of the monitor packet and a packet number representing a numerical position of the 
. monitor packet in the sequence of monitor packets. In the receiving node, the monitor 
packets are reflected back from the receiving node to the sending node in the sequence 
in wliich the monitor packets are received at the sending node. The sending node, upon 
receiving the reflected monitor packets from the receiving node, determines network 
conditions in the connection between the sending node and the receiving node and, from 
the network conditions, determines an optimum packet size and an optimum inter-packet 
interval for transmitting packets from the sending node to the receiving node. 

[058] In a further aspect of the present invention, the receiving node will determine 

network conditions from the received monitor packets, and may store the network 
conditions in one or more condition records. Alternately, the receiving node may return 
the network conditions determined in the receiving node to the sending node, where the 
sending node will update the optimum packet size and Inter-packet interval using the 
network conditions determined in the receiving node. 

[059] In a still further aspect of the present invention, packets will be transmitted from 

the sending node to the receiving node and the receiving node will transmit an 
acknowledgment for each packet received from the sending node. The sending node will 
utilize the acknowledgments received from the receiving node to determine network 
. conditions in the connection wherein the network conditions pertain to the latency and 
jitter of packet transmission between the sending node and receiving node for monitor 
. packets of a known size and known inter-packet transmission interval. The sending node 
will determine from the network conditions an optimum packet size and optimum inter- 
packet interval for transmission of data packets to the receiving node. 

[060] In a yet further aspect of the present invention, the sending node will transmit a 

sequence of data packets from the sending node to the receiving node and the receiving 
node will determine the network conditions from the received data packets. The receiving 
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node will return the network conditions determined in the receiving node to the sending 
node, and the sending node will determine an optimum packet size and an optimum 
inter-packet interval for the transmission of data packets from the sending node to the 
receiving node from the network conditions received from the receiving node. 
[061] BRIEF DESCRIPTION OF THE DRAWINGS 

[0621 The foregoing and other objects, features and advantages of the present invention 

. will be apparent from the following description of the invention and embodiments thereof, 

as illustrated In the accompanying figures, wherein: 
[063] Figs. 1A-1C are charts illustrating network conditions addressed by the present 

invention; 

[064] Fig; 2 Is a diagrammatic representation of an exemplary network system 

incorporating an adaptive packet mechanism; and, 
[065] Fig. 3 is a diagrammatic representation of the OSI protocol model; 

[066] Fig. 4 is a diagrammatic representation of the TCP/IP protocol model; 

[067] Fig. 5 is a diagrammatic representation of an ethernet frame; 

[068] Fig. 6A is a block diagram of an adaptive packet mechanism; 

[069] Fig. 6B is diagrammatic representation of a control script; 

[O7O] Fig. 6C.ls a diagrammatic representation of network condition record; and 

[071] Figs. 7A, 7B and 7C are diagrammatic representations of an implementation of 

the present invention as a single ended system operating in a wireless network. 
[072] DETAILED DESCRIPTION OF THE INVENTION 
[073] A. General Principle of Operation 

[074] It has been described herelri above that the volume of data traffic that may be 

communicated through a network connection between a data source and a data 
recipient, and the time required to communicate the data traffic through the network, is 
determined by the bandwidth of the connection. The bandwidth of a connection is Jn turn 
is determined and limited by the delays inherent in communicating data through the 
connection. The delays in communicating data through a network may, in turn, be 
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regarded as comprised of a relatively constant component and a time variable 
component. The constant component, referred to as the "latency" of the network, 
includes, for example, the inherent delay times through the elements of the network, 
such as through the cables or lines, the switching routers and the communications 
processes or protocols being executed at each end of the connection. The latency of a 
network effects the overall efficiency and effective bandwidth or capacity of a network 
by imposing a practical limit on the maximum rate at which data can be communicated 
through the network, and is often determined by the element of the network connection 
, having the lowest bandwidth. The time variable component of the delays through a 
network, referred to as "jitter", is typically unpredictable and may arise from a number of 
causes, but most frequently results from variations in the traffic load along the route 
taken by a connection through a network. Jitter also effects the overall efficiency and 
effective bandwidth or capacity of a network by imposing a practical limit on the rate at 
which data can be communicated through the network and often limits the effective, 
practical bandwidth of the network or netwbrk connection to a value far below the 
theoretical maximum band\A^idth of the network or network connection. It should also be 
noted that unlike the more constant latency of a network the jitter of a network or network 
connection, which is typically determined by the bandwidth of the lowest bandwidth 
element in the connection, the jitter of a network connection is typically comprised of sum 
of the network jitter components along the connection, which may vary independently. 
[075] In contrast to the methods and mechanisms of the prior art, the present invention 

does not attempt to determine network or connection conditions upon the basis of 
secondary factors, such as packet error, packet loss, packet dropping, or packet 
retransmission rates as in methods of the prior art, although such error factors may be 
used to refine the results of the present invention in certain implementations. The 
present invention instead, determines the data transmission conditions of a network or 
connection solely from externally observed data. That is, the present invention does not 
attempt to monitor conditions or events internal to a network or connection, but instead 
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effectively treats a network or connection as a "black box" and relies solely upon 
capturing and extracting information pertaining to network or connection conditions that 
is directly accessible at the data transmitter and data receiver. 

[076] Also in contrast from the methods of the prior art, the present invention does not 

attempt to control or modify internal conditions or operation of a network or connection, 
but adapts data transmission to the observed network or connection conditions solely by 
control and adaptation of externally controllable data transmission characteristics In 
particular, the present invention attempts to directly determine the optimum bandwidth 
available through a network or connection, and to determine the data transmission 
characteristics to optimally conform to the available bandwidth. More specifically, the 
present invention adapts data transmission to existing real time network or connection 
conditions and available bandwidth by controlling packet size and inter-packet interval. 
Adaptation of network communications to the available bandwidth will, in turn, address 
such secondary effects as packet error rate, packet loss or packet dropping. 

[077] According to the present invention, it is recognized that the latency and jitter of a 

network will vary in time from connection to connection and within a given connection 
and that the latency and jitter of a network or connection are often not linear functions 
with respect to such variables as time, data type or traffic load. As a consequence, the 
latency and jitter of a network are extremely complex or virtually impossible to predict or 
determine. Stated another way, it is at best difficult to monitor or control all of the internal 
operations and conditions necessary to manage communications in a network of 
significant size or complexity so as to reduce or control latency and jitter. According to 
the present invention, however, the latency and jitter of a given network connection and 
the bandwidth of a network connection is a function of the relative size of the packets 
and of the inter-packet interval of the transmissions, that is, the interval between packets 
that are transmitted consecutively through the connection, and may be determined by 
comparison of the relative, comparative latency and jitter of different size packets. 
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[078] These aspects of networks and connections, which are addressed by the present 

invention, are illustrated In Figs. 1A through 1C for exemplary tests of a network 
connection between two Identical Pentium III 500 MHz Sony laptops with 128 MB 
memory wherein the two laptops were connected through the Internet, using Identical 
wireless phones as modems. The connection speeds were at around 10 kilo bits per 
second up and 8 kilo bits per second down and all of the tests used 10KB of total data 
for the transfer. Two tests, tabulated in Figs. 1A and 1B. used an inter-packet delay of 
10msec as the inter packet delay and were separated in time by 200 msec and the third 
test, tabulated in Fig. 1C, used an inter-packet delay of 20ms. A numeric tabulation of 
the tests and test result of the tests illustrated in Figs. 1A through 1C are presented in 
chart form in Appendices A, B and C, respectively. 

[079] It may be seen from these examples that packet size significantly effects packet 

loss, that the packet size - packet loss relation is very unpredictable, with significant 
variation over even short intervals, and that the packet loss experienced by a single 
packet size changes dramatically within milliseconds. For example, it will be noted that 
the results obtained for a given packet size may vary dramatically over even very short 
periods, such as 200 millisecond, that these variations occur for a wide range of different 
packet sizes, ranging from between 50 to 1000 bytes, and that the results obtained for 
a given packet size may even reverse at similar network conditions. It will therefore be 
apparent that the packet size - packet loss relation model for data transmission through 
a network is very complex and very dynamic and changes dramatically over time. As a 
consequence, the latency and jitter of a network or connection are often not linear 
functions with respect to such variables as time, data type, traffic load, packet size or 
inter-packet interval, and the latency and jitter of a network are extremely complex or 
virtually impossible to predict. 

[080] As will be described in the following, the method and mechanism of the present 

invention determines, in real time, the packet size and inter-packet interval that utilizes 
the maximum available bandwidth of the connection most efficiently under current 
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network latency, jitter and traffic conditions by comparison of the relative latency and 
jitter of different sized packets. The present invention then adjusts the transnnitted packet 
size and inter-packet interval in real time to that optimum for the current network and 
connection bandwidth. 

[081] B. General Description of a Network Incorporating the Present invention 

(Fig- 2) 

[0821 Referring to Fig. 2, therein is shown a diagrammatic representation of an 

exemplary Network 10 in which the present Invention may be implemented. Exemplary 
Network 10 may be, for example, a packet based system, such as the Internet and may 
be comprised, for example, of a diverse range of networks linked to packet switched IP 
(Internet Protocol) backbones. A Network 10 Is comprised of a plurality of Nodes 12 
interconnected by Lines 14 wherein Lines 14 may be any of a range of forms of 
transmission media, such as, and for example, fiber optic cables, coaxial lines, telephone 
lines, wireless connections and so on. A Node 12, in turn, may be comprised of a 
computer, network server or router, a network or, for example, a more specialized data 
display or presentation device such as a telephone, mobile phone or processing device, 
television or audio system. 

[083] Packets 16 containing data of any of a wide range of types are communicated 

from a Sending Node 12S to a Receiving Node 12R through a Connection 18, which is 
a Packet 1 6 transmission path between a Sending Node 1 2S and a Receiving Node 12R 
through Network 10. It will be understood by those of ordinary skill in the arts that a 
Connection 18 may be comprised of any combination of Lines 14 and Nodes 12 wherein 
the Nodes 12 in a Connection 18 may include, for example, routers, switches, networks 
or sub-networks or servers operating to establish a Connection 18 between a Sending 
Node 12S and a Receiving Node 12R. It will also be understood that a Connection 18 
or a Network 10 or the path followed by Packets 16 may conform to a range of 
topologies, such as Frame Relay or an ATM. It will also be understood that a Connection 
18 may be and typically is bi-directional, with the Sending Node 12S and the Receiving 
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Node 12R alternating as the Sending Node 12S and Receiving Node 12R, depending 
upon the direction in which Pacl^ets 16 are being transmitted at any time. It will therefore 
be understood that the designations Sending Node 12S and Receiving Node 12R are 
solely for illustrative purposes in the following descriptions, and are not to be talcen or 
understood as limiting or defining of the structure or function of a given Node 12. For 
example, a router in a Connection 16 may be regarded as, and for purposes of the 
present invention, may comprise either or both of a Sending Node 12S and Receiving 
Node 12R to receive Packets 16 from a Node 12 and to transmit Packets 16 onwards 
to another Node 12, and the present invention may be implemented within a Node 12 
that is a router, switch or other element of a Connection 16. 

[084] It will also be understood by those of ordinary skill in the relevant arts that in, for 

example, a connectionless Network 10, each Packet 16 may travel over a different path 
of one or more networks or routes through one or more networks to anive at the 
Receiving Node 12R. In such networks, and for purposes of the present invention, it will 
be understood that a Connection 16 may not and typically will not be comprised of a 
single path of Lines 14 and Nodes 12, such as routers and switches, but will be 
comprised of a time varying set of paths of Lines 14 and Nodes 12. In such instances, 
and for purposes of the following discussions of the present invention, such a time 
varying set or group of paths will be referred to as a "Connection 16" and it will be 
understood that the methods and mechanisms of the present invention will treat such a 
"connectionless Connection 16" as a Connection 16. In essence, and stated another 
way, the methods and mechanisms of the present invention will treat "connectionless 
Connections 14" as a Connection 16 having, for example, greater than average 
variations in latency and jitter from Packet 16 to Packet 16. 

[085] Lastly in this regard, it will be understood that a Packet 1 6 may contain any form 

of data, including, for example, audio or video information or a combination of audio and 
video information. In such instances, the audio information may include, for example, 
music, voice communications or a soundtrack and the video information may include, for 
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example, animated graphics, a movie or a video signal. As such, the transfer or 
transmission of data from one Node 12 to another Node 12 may comprise the 
transmission of a single Pacicet 16 or of a sequence of Packets 16. 

[086] As illustrated in Fig. 2 and as described in further detail in subsequent 

descriptions, the method and mechanism of the present invention is embodied in an 
Adaptive Packet Mechanism 20 that operates to determine the optimum Data Packet 16 
size and inter-packet interval to most efficiently utilize the maximum available bandwidth 
of a Connection 16 between a Sending Node 12R and a Receiving Node 12R for the 
current conditions of Connection 1 6 latency and jitter. As described, this optimum packet 
size and inter-packet interval will, as a consequence, yield the highest probability of 
packets anriving successfully at a given Receiving Node 12R. As will be described in 
further detail in the following, Adaptive Packet Mechanism 20 operates to determine the 
current maximum available bandwidth and latency and jitter conditions of a Connection 
16 by determining the Connection 16 conditions, referred to hereinafter as the network 
conditions directly determined by the Connection 16 bandwidth and directly determining 
the Connection 16 bandwidth, including the Connection 16 available bandwidth and the 
latency and jitter through the Connection 16 for selected sizes of Packets 16. 

[087] In a presently preferred embodiment, Adaptive Packet Mechanism 20 includes or 

is comprised of two or more Packet Transfer Engines (PTE) 20Tand one or more 
Collector/Controllers 20C. Briefly, and as will be described in further detail in following 
descriptions, a Transfer Engine 20T residing at a Sending Node 12S of a Connection 18 
may operate under the direction of a Collector/Controller (C/C) 20CA to transmit 
sequences of one or more Monitor Packets 1 6M to a Transfer Engine 20T residing in the 
Receiving Node 1 2T of the Connection 1 8. One or both of the Packet Transfer Engines 
(PTE) 20T of the Connection 18 will determine the transmission characteristics of the 
Monitor Packets 1 6M through the Connection 1 8 and will extract or determine the current 
network conditions of the Connection 1 8, such as available bandwidth, latency and jitter. 
The network condition information will then be provided to a Collector/Controller (C/C) 
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20C, which will determine the optimum packet size and inter-pacl^et interval for the 
current network conditions qf the Connection 18. 

[088] In addition, the Packet Transfer Engines (PTE) 20T residing at the Sending Node 

12S and at the Receiving Node 12R will operate as data communications protocol stack 
mechanisms, that is and for example, as a Transmission Control Protocol/Internet 
Protocol ("TCP/IP") mechanism, to communicate "payload" Data Packets 16C of the 
optimum packet size and at the optimum inter-packet interval between a Data Source 
22S in the Sending Node 12S and a Data Recipient 22R in the Receiving Node 12R. 

[089] It will therefore be apparent that a Packet Transfer Engine (PTE) 20T will reside 

in each Node 12 of a Network 10 that is to function as a Sending Node 12S or as a 
Receiving Node 12R according to the present invention. Certain Nodes 12, however, 
may contain more than one Packet Transfer Engine (PTE) 20T. Examples of such would 
include, for example, Nodes 12 that are required to support more than one 
ConnectionIB, such as a router connected to more than one Network 10 or a server 
supporting a plurality of Connections 18 to other Nodes 12 concurrently. It will also be 
understood that a Network 10 may require only a single Collector/Controller (C/C) 20C 
as a Collector/Controller (C/C) 20C may operate with and control a plurality of Packet 
Transfer Engines (PTE) 20T, but may include a plurality of Collector/Controllers 20C, 
each of which may support a plurality of Packet Transfer Engines (PTE) 20T. Also, a 
Collector/Controller (C/C) 20C may reside in a Node 12 with a Packet Transfer Engine 
(PTE) 20T, that is, in either a Sending Node 12S or a Receiving Node 12R, or may 
reside in a Node 12 separate from the Nodes 12 in which the Packet Transfer Engines 
(PTE) 20T reside. The number and configuration of Packet Transfer Engines (PTE) 20T 
and Collector/Controllers 20C in a Network 10 will therefore depend, for example, upon 
the upon the number and configuration of Nodes 12 that are to operate as Sending 
Nodes 12S or Receiving Nodes 12R, or as both, the number of Connections 18 to be 
supported at any time, and so on. 
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[090] Also, and although not shown in detail in Fig. 2, it will be recognized and 

understood that a Packet Transfer Engine (PTE) 20T residing in a Sending Node 12S 
or a Receiving Node 12R will effectively reside in and function as a layer or element of 
a layer of the Network Protocol Stack (Stack) 24 the Sending Node 12S or Receiving 
Node 12R. For example, in a presently preferred embodiment of an Adaptive Packet 
Mechanism 20. Packet Transfer Engines (PTE) 20T communicate Packets 16 at the 
UDP layer of TCP/IP and Packet Transfer Engines (PTE) 20T communicate with 
Collector/Controllers 20C at the TCP layer of TCP/IP. It will be recognized and 
understood, however, that an Adaptive Packet Mechanism 20 may execute or operate 
with a wide variety of protocols and at a number of different layers of such protocols for 
the transfer of data through Networks 16. While the type, degree and methods for 
interoperating with such aspects of the protocols as packet size and Inter-packet Interval 
may vary significantly between protocols, such protocols are widely known and well 
understood by those of ordinary skill in the relevant arts, the details of particular 
protocols. As such, the means and methods by which various implementations and 
embodiments of the Adaptive Packet Mechanism 20 of the present invention may be 
adapted to each protocol will not be discussed In detail herein. 

[091] It should also be noted with regard to the following discussions of an exemplary 

implementation of an Adaptive Packet Mechanism 20 that an Adaptive Packet 
Mechanism 20 will commonly be implemented by means of the program control of 
processors, such as personal computers or network servers, although at least certain 
mechanisms or functions of an Adaptive Packet Mechanism 20 may be implemented in 
dedicated circuitry. The possible implementations of Data Transmitters 10, Data 
Receivers 20 and Adaptive Packet Mechanisms 32 will be well understood by those of 
ordinary skill in the relevant arts, however, and as such will not be discussed in further 
detail herein. 

[092] C. Description of An Adaptive Packet Mechanism 20 (Fig. 2, 3, 4 and 5) 

[093] 1. General Discussion of Data Communications Protocols (Figs. 3, 4 and 5) 
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[094] It has been described herein above that virtually all networks employ multiple 

layered protocols to facilitate and implement data communications, wherein the layers 
of a protocol are often referred to as the "stack" or "stacks" of the protocol. Each layer 
of a protocol defines and controls a corresponding level of operations in the 
communications through the network, and the number of layers and functions performed 
by each will depend upon the needs of the network communications. For example, the 
physical layer of a protocol typically defines and controls the lowest level of operations 
and will commonly include a low-level physical or device layer that assures the 
transmission and reception of a data stream between network devices communicating 
through the Connections 14. A higher level data link layer defines and manages the 
construction and transmission of data packets, while still higher level network and 
transport layers govem the transmission of data through the network. Figs. 3, 4 and 5 
and the following discussions will briefly describe the layers of two commonly used and 
standard exemplary typical protocols, which have been discussed above as "Network 
Protocol Stacks (Stacks) 24". The two examples discussed below are the Open Systems 
Interconnection (OSl) Protocol Model 240 and the Transmission Control 
Protocol/internet Protocol (TCP/IP) 24T, both of which are very commonly used in. for 
example, Internet communications. 

[095] As illustrated generally in Figs. 3 and 4, a communication Request 26 containing 

typically originates in a Sending Node 12R at the uppermost Layer 28 of the Protocol 24 
and is passed down through the succeeding Layers 28, or stack, in the form of a Protocol 
Packet 16P, which may be referred to as a Protocol Data Unit (PDU) 30. Layers 28 
communicate with the adjacent Layers 28 through one or more Service Access Points 
(SAPs) 32, and each succeeding Layer 28 in the stack adds its own information to the 
Protocol Packet 16P. At the lowest level Layers 28, the resulting Packet 16 is encoded 
into Data Frames 34 and is placed onto the Connection 16 of the Network 10 for 
transmission to the Receiving Node 12R, 
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[096] The Data Frames 34 traverse the Connection 16 to the Receiving Node 12R, 

where the entire process is reversed as the Pacl<et 1 6 is processed upwards through the 
Layers 28 of the Protocol 24 stack as a Protocol Packet 16P. As it moves up the stack, 
each Layer 28 "unwraps" its respective elements of the Protocol Packet 16P that were 
added to the Protocol Packet 16P by the peer Layer 28 on the Sending Node 12R and 
thereby receives Information from its peer Layer 28 on the Sending Node 12R. 

[097] It should be noted that in most communications operations no Layers 28 are 

bypassed, although certain of the higher Layers 28 may not be utilized in certain 
instances, and that a Layer 28 on a Sending Node 12R or Receiving Node 12R may not 
communicate directly with its peer Layer 28 on the other node. That is, peer-to-peer 
Layer 28 communication only takes place by adding messages to the Protocol Packet 
16P and sending the Protocol Packet 16P down through the succeeding Layers 28, 
across the Connection 16, and then up the stack to the peer Layer 28 on the opposing 
node. As will be noted in the following discussions, however, certain types of 
Transmitting Nodes 18 and Receiving Nodes 20, such as routers, operate within only 
relatively few Layers 28 of a Protocol 24 stack, primary the lower Layers 28. It should 
also be noted that an Adaptive Packet Mechanism 20 of the present invention may 
interface and interoperate with a lower Layer 28 of a Protocol 24 Stack. 

[098] Referring now to Fig. 3 and first considering the OSI Protocol Model 240, the OSI 

Protocol Model 240 is comprised of seven Layers 28 defining a progression of tasks 
performed in passing information from a user's application to the destination application. 
The Layers 28 compartmentalize specific functions and each Layer 28 has a weH-defined 
interface and a clearly defined entry and exit point, or SAP 32. Each Layer 28 is thereby 
transparent to the adjacent Layers 28 and a Connection 16 is "virtual", or transparent, 
to a Sending Node 12R and Receiving Node 12R. OSI Protocol Model 240 also 
embodies an "acknowledgment" mechanism wherein, as discussed herein above, a next 
packet is transmitted by the Sending Node 12R only after receiving an acknowledgment 
packet for the preceding transmitted packet. Lastly, it should be noted that not all 
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network communications extend to or through all Layers 28 of the OSI Protocol Model 
240- For example, communication between different hosts using reliable TCP/IP 
communications might traverse every Layer 28 of the OSI Protocol Model 240, while 
local Windows for Workgroups communications within the same Network 10 using an 
IBM Protocol 24 or communication between routers may occur only at the data link Layer 
28 and physical Layers 28. 

[099] Briefly considering each of the Layers 28 of the OSI Protocol Model 240, the 

lowest Layer 28 is Physical Layer 28A, which represents the physical characteristics of 
the Network 10, such as the transmission media, transmission devices, Networi< 16 
structures and configurations, such as bus, star, ring, and mesh topologies, and the data 
signals across the transmission media. 

[100] The Data Link Layer 28B. In turn, embodies the communication functions of a 

Network 10, such as a (Local Area Network) LAN. Data Link Layer 28A is responsible 
for Initiating the first level of a rudimentary structure of data bits, the data link Frame 34, 
controls the flow of data to the destination device. A Frame 34 is organized into fields of 
Information that identify the start and end of the Frame 34, the address of the Sending 
Node 12R, the address of the Receiving Node 12R, and error checking methods. The 
Data Link Layer 28B is structured as two sub-Layers 28, wherein the Media Access Control 
(MAC) sub-Layer 28BA refers to the MAC Protocol 24 which monitors access to the 
media by giving permission to transmit data, resolving conflicts, passing tokens, and 
polling. The MAC sub-Layer 28BA also locates the physical addresses at each station 
on the network, which become the source and destination data on the data link Frame 
34. The Logical Linl< Control (LLC) sub-Layer 28BB, in turn, includes part of the data link 
administrative or control fields, such as frame synchronization, flow control and error 
checking within the Frame 34, and a unique address that is located in the Physical Layer 
28 A. The physical properties of a Network 10 infrastructures such as the Ethernet, Token 
Ring, or other LAN networking systems, Attached Resources Computer Network 
(ARCNET), LocalTalk, Fiber Digital Device Interface (FDDI) are thereby defined in the 
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Physlcal Layer 28, while their communication properties are defined in the Data Link 
Layer 28B, 

[101] Network Layer 28C of the OSI Protocol IVIode! 240 is responsible for network 

processes to reliably send and receive data between networks. For example, a diagram 
of a standard Ethernet Frame 34 as may be sent through a Router 24 through Network 
Layer 28C using the TCP/IP is shown in Fig. 5. 

[1 02] Network Layer 28C provides logical addressing, network routing, flow control that 

monitors the network connection, and sequencing and translation functions. Addressing 
is also performed in Network Layer 28, and the form of addressing is specific to a given 
protocol. For example, an Ethernet workstation may run both TCP/IP and Novell 
IPX/SPX Network Layer 28C protocols wherein each Network Layer 28C protocol will 
have a different logical addressing method. The Network Layer 28C protocols, such as 
TCP/IP, UDP/IP, IPX/SPX, DECNET, are also used by routers to interconnect Networks 
1 6. It must be noted, however, that there are certain Network 1 0 Protocols 24 that to not 
extend to the Network Layer 28, These include DECLAT, IBM's Network Basic 
Input/Output System (NetBIOS), IBM's Extended User Interface (NetBEUI) for NetBIOS, 
and others. These Protocols 24 have no provisions for Network Layer 28C addressing 
and routing, so that connection of these Protocols 24 between different LANs must be 
accomplished with MAC sub-Layer 28BA devices such as LAN bridges or LAN switches. 

[103] Transport Layer 28D provides reliable network-to-network communications by 

providing service addressing, flow control, datagram segmentation, and source to 
destination error checking. Error checking also occurs in the Data Link Layer 28B and 
in Session Layer 28E, discussed below. A primary function of Transport Layer 28D is to 
pack data sent down from higher Layers 28 into smaller pieces, referred to as segments, 
and to assign each segment a segment number so that the data can be reassembled in 
the correct sequence and without errors in the Transport Layer 28D in the Receiving 
Node 12R. 
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[1 04] Service addressing is unique to the Transport Layer 28D, wlierein Transport Layer 

28D identifies addresses or ports pointing to upper Layer 28 networl< services. This level 
of addressfng also monitors multiple connections or conversions that may occur in a 
Network 10 by tracking the connection identifiers, that is a connection identifier, port, or 
socket, or a transaction identifier that can track each request as opposed to tracking a 
conversion. 

[1 05] Session Layer 28E of the OS! Protocol Model 240 is responsible for establishing, 

maintaining and terminating a connection to a session. l\/lanaging a session involves 
synchronization of user tasks and dialog control, that is, what process is able to transmit 
and for what length of time. Synchronization involves the use of checkpoints or 
"acknowledgment numbering" and retransmission procedures. Session Layer 28E is also 
responsible for logon, name recognition and security functions and relies on the 
Transport Layer 28D in these functions. 

[106] Presentation Layer 28F of the OSI Protocol Model 240 translates and converts 

the form and structures of data among the hosts in which the data resides or is 
transmitted to, thereby allowing the data to be operated upon and with by each host in 
which It resides. The operations performed by Presentation Layer 28F may, for example, 
include conversion of file organizations, beginning/ending boundaries, naming 
conventions, access security and file storage methods. The conversions performed by 
Presentation Layer 28F are also performed at the byte and character levels, and may 
include file syntax conversions, encryption/decryption processes and 
compression/decompression processes. For example, Presentation Layer 28F may 
convert data using the American Standard Code for Information Interchange (ASCII) and 
having the left-most bit of a byte of data the highest order or most significant bit into data 
using IBM's Extended Binary Coded Decimal Interchange Code (EBCDIC) for which the 
left most bit is the lowest order of least significant bit. 

[107] Lastly, Application Layer 28 G of the OSI Model Protocol 240 provides the 

operating system of the host system with direct access to network services, such as a 
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mail client, a web browser, or file transfers. Application Layer 28G also provides user 
applications, such as word processing programs, spreadsheet programs and other 
applications with an interface to the networic services to allow, for example, an 
application program to retrieve a file from a networl< server. 

[1081 Referring now to Transmission Control Protocol/Internet Protocol (TCP/IP) 

Protocol 24T, as illustrated in Fig. 4 the architecture of TCP/IP Protocol 24T includes an 
Application Layer 28H, a Transport Layer (TCP/UDP) 281, an Internet Protocol (IP) 
Layer 28J and a Network Layer 24K. Again, each of Layers 28H through 24K represents 
specific tasks that are accomplished when data is transmitted utilizing the TCP/IP 
Protocol 24T, and as each succeeding Layer 28 receives a data packet, that Layer 28 
performs its tasks and spends the packet onto the next level 

[1 09] Network Layer 24K includes hardware devices for Network 1 0 communication and 

programs and processes for controlling communications at the Network 10 hardware 
level. As in the instance of the OSI Model Protocol 240, TCP/IP Protocol 24T supports 
virtual paths through the Network 10 between, for example, Transmitting Nodes 18 and 
Receiving Nodes 20, and communications configurations such as Asynchronous 
Transfer Mode, Ethemet and Frame-Relay. 

[110] Internet Protocol (IP) Layer 28J, in turn, represents a connectionless datagram 

protocol that defines standards for message transmission on and between Networks 16, 
which may be significantly dissimilar. Packet addressing, that is, Internet Protocol (IP) 
packets, allow error free transmission to be the responsibility of the Transmitting Nodes 
18 and Receiving Nodes 20 on an equal peer-to-peer basis, rather than relying on the 
links in the Network 10 environment. Internet Protocol (IP) Layer 24J also supports can 
be used for a basis of communication even between dissimilar networks that support 
dissimilar Protocols 24 using gateway connections. 

[Ill] TCP/IP Protocol 24T is connection oriented packet transport system that 

establishes a connection between a Sending Node 12R and a Receiving Node 12R 
before the data is transmitted. Transport Layer 28K is responsible for management and 



wo 02/101513 PCTAJS02/18864 



-39- 

control of data flow, including data flow speed adjustment to minimizes data corruption, 
and includes the TCP and UDP protocols for these purposes. 

[112] In particular, the TCP protocol of Transport Layer 28K includes mechanisms for 

packet flow control, packet retransmission, packet sequencing and error correction. In 
the flow control functions, both the transmitting and the receiving node have control over 
the packet transmission rate in a manner that alleviates the probability of packet 
overflow. In addition, an acknowledgment of packet reception is transmitted from the 
receiving node to the transmitting node when a packet reaches a destination, thereby 
inform the sender that the packet has arrived intact. If the packet does not arrive intact 
and the sender does not receive acknowledgment within a specified time, the packet is 
retransmitted. In addition, the packets are numbered and transmitted in sequential order 
so that, should packets be transmitted or received out of order or should packets have 
to be retransmitted, the receiving node is enabled to reassemble the packets in the 
correct order. Finally, the TCP generates and checks a checksum In each packet that 
records the original data bits of the packet, thereby providing error detection. 

[1 13] UDP protocol of Transport Layer 281 excludes the connection setup process, flow 

control and retransmission/error checking functions of the TCP protocol, thereby 
providing minimum transmission delay. The UDP protocol is primarily used, for example, 
in transmitting IP address data, as the lack of the functions provided by the TCP protocol 
may result in data degradation. 

[1 1 4] Lastly, Application Layer 24H establishes client/server application protocols, such 

as for file transfers, e-mail, web applications, and so on. Such client/server protocols may 
include, for example, File Transfer Protocol (FTP) for the file transfer and directory 
management of remote computers, Simple Mail Transport Protocol (SMTP) for e-mail 
delivery; and the Hyper Text Transport Protocol 24 (HTTP) used on the Worid Wide 
Web. 

[115] 2. Adaptive Packet Mechanism 20 (Fig. 6A, 6B, and 6C) 
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[116] It has been described above that a Adaptive Packet IVIechanism 20 includes or 

is comprised of one or more Collector/Controllers 20C and two or more Packet Transfer 
Engines (PTE) 20T. Packet Transfer Engines (PTE) 20T operate under control of a 
Collector/Controller (C/C) 20C to determine the network conditions of Connections 18, 
wherein the network conditions examined by an Adaptive Packet Mechanism 20 pertain 
to the latency and jitter and the available bandwidth of the Connections 18, and to 
determine from these network conditions the optimum packet size and optimum Inter- 
packet interval for the transmission of data packets through the Connections 1 8 for given 
amounts and types of data. As will be described, an Adaptive Packet Mechanism 20 
operates in a number of modes to acquire the network condition infonmation. including 
the transmission of Monitor Packets 12M through the Connections 18 and by 
examination of the transmission of Data Packets 12D through the Connections 18. As 
will be described, the operations and functions of an Adaptive Packet Mechanism 20 are 
accomplished through a Packet Transfer Engine (PTE) 20T in each Node 12 that is to 
be a Sending Node 12S or a Receiving Node 12R or both, and a Collector/Controller 
(C/C) 20C that may reside, for example, in a Sending Node 12S or in a Node 12 
separate from the Nodes 12S and 12R. 

[117] Referring to Fig. 6A, therein is illustrated the structure and operation of an 

Adaptive Packet Mechanism 20 with respect to a single Connection 18 between a 
Sending Node 12S and a Receiving Node 12R. As shown therein, a Packet Transfer 
Engine (PTE) 20T resides in the Sending Node 12S, and will hereafter be identified as 
the Packet Transfer Engine (PTE) 20TS, and second Packet Transfer Engine (PTE) 20T 
resides in the Receiving Node 12R, and will hereafter be identified as the Packet 
Transfer Engine (PTE) 20TR. It will be understood that the designations of Nodes 12 in 
Fig. 6A as Sending Nodes 12S and Receiving Nodes 12R and the corresponding 
designations of the Packet Transfer Engines (PTE) 20T as a Packet Transfer Engine 
(PTE) 20TS and a Packet Transfer Engine (PTE) 20TR are solely for purposes of the 
present discussions and are not intended or meant to be limiting. For example, the 
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designations of sending and receiving Nodes 1 2 and Packet Transfer Engines (PTE) 20T 
would periodically in bi-lateral data packet communication between the Nodes 12, when 
the flow of data packets reverses, or that a Node 12 may operate as a Sending Node 
12S in one Connection 18 and as a Receiving Node 12R in a different Connection 18. 

[118] It has also been described herein above that a Collector/Controller (C/C) 20C 

operating with and controlling the Packet Transfer Engine (PTE) 20TS and Packet 
Transfer Engine (PTE) 20TR of a Connection 18 may reside in any Node 12 of the 
Network 10. It will therefore be understood that the Collector/Controller (C/C) 20Cis 
shown in Fig. 6A as residing in Sending Node 12S only for purposes of illustration, and 
that this representation is not intended or meant to be limiting. As shown in Fig. 6A, and 
as will be discussed in further detail in a following description, Collector/Controller (C/C) 
20C includes or is associated with a Network Analyzer 48 that may be implemented in 
a number of forms, but which receives the network condtion information acquired by 
Packet Transfer Engine (PTE) 20TS or by Packet Transfer Engine (PTE) 20TS in 
combination with Packet Transfer Engine (PTE) 20TR and information pertaining to a 
currently to be executed data transfer to determine the optimum packet size and inter- 
packet interval under the current Connection 18 conditions and for the amount and type 
of data to be transferred. As will be discussed in the following, and for example, a 
Network Analyzer 48 may be implemented as fuzzy logic, or as a neural network or as 
a combination of a neural network with fuzzy logic, and the mode by which network 
condition information is acquired and used by the Collector/Controller 20C will be 
determined in part by the specific method used to implement Network Analyzer 48. In the 
reverse, the method used to implement Network Analyzer 48 will be determined in part 
by the methods and modes of operation available to acquire the network information and 
the types of network condition information that may be acquired. 

[119] Also, it has been described that a Packet Transfer Engine (PTE) 20T residing in 

a Sending Node 12S or a Receiving Node 12R will effectively reside in and function as 
a Layer 28 or element of a Layer 28 of the Network Protocol Stack (Stack) 24 the 
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Sending Node 12S or Receiving Node 12R to form, transmit and receive Packets 1 6, For 
example, in a presently preferred embodiment of an Adaptive Packet Mechanism 20, 
Packet Transfer Engines (PTE) 20T communicate IVIonitor Packets 16M and Data 
Packets 16C at the UDP layer of TCP/IP and communicate with Collector/Controllers 
20C at the TCP layer of TCP/IP. It will be recognized and understood, however, that an 
Adaptive Packet Mechanism 20 may execute or operate with a wide variety of protocols 
and at a number of different layers of such protocols for the transfer of data through 
Networks 16. While the type, degree and methods for interoperating with such aspects 
of the protocols as packet size and inter-packet interval may vary significantly between 
protocols, such protocols are widely known and well understood by those of ordinary skill 
in the relevant arts, the details of particular protocols. As such, the means and methods 
by which various implementations and embodiments of the Packet Transfer Engines 
(PTE) 20T of the present invention may be adapted to and implemented in each protocol 
will not be discussed in detail herein. 
[120] As described, the Collector/Controller (C/C) 20C, Packet Transfer Engines (PTE) 

20TS and Packet Transfer Engine (PTE) 20TR associated with a Connection 18 are 
capable of multiple modes of operation. For example, in the data transfer mode the 
Collector/Controller (C/C) 20C, Packet Transfer Engines (PTE) 20TS and Packet 
Transfer Engine (PTE) 20TR operate to transfer data from the Sending Node 12S to the 
Receiving Node 12R through the Connection 18. In the network data collection and 
network condition determination modes, hereafter referred to as the "test" modes, the 
Collector/Controller (C/C) 20C. Packet Transfer Engines (PTE) 20TS and Packet 
Transfer Engine (PTE) 20TR associated with a Connection 18 will operate to determine 
the network conditions of the Connection 18, such as available bandwidth, latency and 
jitter, and from this information will determine the currently optimum Packet 16 size and 
inter-packet interval for communicating Data Packets 1 6C through the Connection 1 8 for 
a given amount and type of data. 
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[1211 Considering the modes of operation of an Adaptive Packet [\/lechanism 20 in 

general, the Collector/Controller (C/C) 20C and the Packets Transfer Engines 20TS and 
20TR may aiternate between a data transfer mode of operation in which the data is 
transferred from the Sending Node 12S to the Receiving Node 12R and a network 
condition acquisition mode of operation in which information is collected regarding 
network conditions. In other modes, the Adaptive Packet Mechanism 20 may acquire 
network condition information during data transfers, that is, by examination of the 
transmission characteristics revealed during the transmission of Data Packets 12D. in 
still other circumstances, the Adaptive Packet Mechanism 20 may operate In an initial 
or preliminary network condition collection mode to acquire network condition information 
that may be is used, for example, to train a neural network in Network Analyzer 48 or to 
build a fuzzy logic analyzer for use in Network Analyzer 48. Thereafter, the Adaptive 
Packet Mechanism 20 may operate in either of the first two mention modes to acquire 
network condition information to update or modify the network condition information 
acquired during the initial or preliminary network condition collection operations. 

[122] In the network condtion collection modes of operation, and depending upon the 

specific network condition collection mode, one or both of the Packet Transfer Engines 
(PTE) 20TS and 20TR of the Connection 18 may acquire network condition information 
by determining the transmission characteristics of either or both of Monitor Packets 1 6M 
or Data Packets 1 2D transmitted through the Connection 1 8 from the Sending Node 1 2S 
to the Receiving Node 12R, and will extract or determine the current network conditions 
of the Connection 18, such as available bandwidth, latency and jitter. As described, the 
network condition information is provided to a Collector/Controller (C/C) 20C, wherein 
Network Analyzer 48 will determine the optimum packet size and inter-packet interval for 
the current network conditions of the Connection 1 8 and Collector/Controller (C/C) 20C 
will use these optimum packet size and inter-packet interval values during the data 
transfer mode. 
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[123] In general, the network condition collection mode selected for given 

circumstances is dependent upon both the packet size and inter-packet interval 
detemiine methods implemented in the Network Analyzer 48 and the type of data 
transfer to be executed. In this regard, it has been previously described that data 
transfers through a network may be characterized as "continuous", wherein the stream 
of data packets is essentially continuous for an extended period, or "bursty", which is 
characterized by the transmission of "bursts" of data packets separated by intervals in 
which no packets are transmitted. A "continuous" transfer may occur, for example, in the 
transfer of audio/video information while a "bursty" transfer may occur, for example, in 
the transfer of data flies. 

[124] As will be described in the following, in a presently preferred embodiment an 

Adaptive Packet Mechanism 20 is capable of operating in several basic network 
condition acquisition modes, certain of the modes being intended primarily for "bursty" 
data transfers and others being primarily intended for "continuous" data transfers while 
others are used in the preliminary or initial acquisition of network condition information 
to be used, for example, in training a neural network or in designing a fuzzy logic 
analyzer . In the case of "bursty" data transfers, there may be or are extended, periods 
during which Data Packets 12D are not being transmitted and during which inforniation 
regarding the Connection 18 transmission conditions cannot be determined by 
observation of the Data Packets 12D. In these cases, sequences of Monitor Packets 
12M are periodically transmitted between the Sending Node 12S and the Receiving 
Node 12R, when Data Packets 12D are not being transmitted, and the network 
conditions of the Connection 18 are determined from the transmission characteristics of 
the Monitor Packets 12M. In the instance of "continuous" data transmissions, the 
Connection 18 is essentially fully occupied by the transmission of Data Packets 1 2D, and 
the network conditions are primarily determined from observation of the Data Packets 
12D. 
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[125] Before discussing the modes of operation of Collector/Controller (C/C) 20C and 

Packet Transfer Engines (PTE) 20TS and 20TR in detail, it should be noted that in the 
presently preferred implementation, the modes of operation are controlled in part by 
inputs from Data Source 22S or from some other source in the Sending Node 12S 
indicating, for example, what type of data transfer operation is to be performed, such as 
a file transfer or the transmission of a continuous audio/video data stream, and the 
amount of data to be transferred. The Collector/Controller (C/C) 20C, in turn, selects an 
appropriate mode of operation for the particular data transfer requested by the Sending 
Node 1 2S, including the method by which network condtion information Is to be acquired. 
The Collector/Controller (C/C) 20C, in turn, generates Control Outputs 38C to the Packet 
Transfer Engines (PTE) 20TS and Packet Transfer Engine (PTE) 20TR to control the 
modes of operation of the Packet Transfer Engines (PTE) 20TS and Packet Transfer 
Engine (PTE) 20TR during the requested data transfer. As will be described below, 
packet transfers between the Sending Node 12S and the Receiving Node 12R will 
involve both a data transfer mode and one or more network condition collection modes 
and may require the Collector/Controller (C/C) 20C and the Packet Transfer Engines 
(PTE) 20TS and Packet Transfer Engine (PTE) 20TR involved in the operation to switch 
between the data transfer modes and the network condition collection modes during the 
data transfer. In the presently preferred embodiment, the modes of operation of the 
Collector/Controller (C/C) 20C and the Packet Transfer Engines (PTE) 20TS and Packet 
Transfer Engine (PTE) 20TR are detemriined by flags set in the Collector/Controller (C/C) 
20C and the Packet Transfer Engines (PTE) 20TS and Packet Transfer Engine (PTE) 
20TR by the Collector/Controller (C/C) 20C. 

[126] In this regard, it must be noted that when the Collector/Controller (C/C) 20C, 

Packet Transfer Engines (PTE) 20TS and Packet Transfer Engine (PTE) 20TR 
associated with a Connection 18 are operating in a network condition acquisition mode 
to determine the current network conditions of the Connection 18, the operations of the 
Adaptive Packet Mechanism 20 are controlled by a Script File 38. As indicated in Fig. 6A, 
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Script File 38 is read by the Collector/Controller (C/C) 20C, whicli in turn generates 
corresponding Control Outputs 38C to the Packet Transfer Engine (PTE) 20TS or to both 
the Packet Transfer Engine (PTE) 20TS and the Packet Transfer Engine (PTE) 20TR, 
depending upon the network condition acquisition mode. An exannple of a Script File 38 
is illustrated in Fig. 6B and, as script files are well known to those of ordinary skill in the 
arts and as the purpose and function of each step in the script file is described in the 
example shown in Fig. 6B, Script Files 38 will not be discussed in further detail herein. 
[127] a. Data Transfer Mode 

[128] First considering the data transfer mode, that is, the method by which Data 

Packets 12D are transferred from a Sending Node 12S to a Receiving Node 12R, the 
Packet Transfer Engines (PTE) 20TS and 20TR residing at the Sending Node 12S and 
at the Receiving Node 12R will operate as or as part of the data communications 
Network Protocol Stack (Stack) 24 mechanisms of the Sending Node 12S and the 
Receiving Node 1 2R. That is and for example, Packet Transfer Engines (PTE) 20TS and 
Packet Transfer Engine (PTE) 20TR operate as a Layer 28 of the Transmission Control 
Protocol/Internet Protocol ("TCP/IP") mechanism to communicate "payload" Data 
Packets 16C between a Data Source 22S in the Sending Node 12S and a Data 
Recipient 22R in the Receiving Node 12R. For example, in a presently preferred 
embodiment of an Adaptive Packet Mechanism 20, Packet Transfer Engines (PTE) 20TS 
and 20TR communicate Monitor Packets 16M and Data Packets 160 at the UDP layer 
of TCP/IP and communicate with Collector/Controllers 20C at the TCP layer of TCP/IP. 

[129] In the data transfer mode, and according to the present Invention, the 

Collector/Controller (C/C) 20C will provide a Packet Control 36 output to the Packet 
Transfer Engine (PTE) 20TS in the Sending Node 12R wherein the Packet Control 36 
output will designate an Optimum Packet Size 36S and an Optimum Inter-Packet Interval 
361 for the current Connection 18 network conditions. The Packet Transfer Engine (PTE) 
20TS will receive Data 22D from the Data Source 22S or from higher Layers 28 of the 
Network Protocol Stack (Stack) 24, depending upon the Layer 28 at which the Packet 
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Transfer Engine (PTE) 20TR is implemented, and will "packetize" the Data 22D into Data 
Packets 16C of the size designated by the Optimum Packet Size 36S- The Packet 
Transfer Engine (PTE) 20TS will transmit the Data Packets 16C to the Connection 18 
at inter-packet intervals designated by Optimum Inter-Packet Interval 361, either directly 
or through lower Layers 28 of the Network Protocol Stack (Stack) 24, depending upon 
the Layer 28 at which the Packet Transfer Engine (PTE) 20TS is implemented. 
[1 30] The Data Packets 1 6C are transferred through the Connection 1 8 to the Receiving 

Node 12R, and the Packet Transfer Engine (PTE) 20TR will receive the Data Packets 
16C from the Connection 18, either directly or from lower Layers 28 of the Network 
Protocol Stack (Stack) 24, depending upon the Layer 28 at which the Packet Transfer 
Engine (PTE) 20TR is implemented. The Packet Transfer Engine (PTE) 20TR will 
"depacketize" the Data 22D and wilt pass the Data 22D to the Data Recipient 22R, either 
directly or through higher Layers 28 of the Network Protocol Stack (Stack) 24, again 
depending upon the Layer 28 at which the Packet Transfer Engine (PTE) 20TR is 
implemented. The Packet Transfer Engine (PTE) 20TS will form the Data 22D into Data 
Packets 16C of the size designated by Optimum Packet Size 36S and will transmit the 
Data Packets 16C at the Inter-packet Interval designated by Optimum Inter-Packet 
Interval 361. 

[131] b. Network Condition Acquisition Mode, Monitor Packets 12M 

[132] In a first network data collection and network condition determination mode, the 

Transfer Engine 20TS residing at the Sending Node 12S of a Connection 18 will, under 
the direction of the Collector/Controller (C/C) 20C, transmit sequences of one or more 
Monitor Packets 16IVI to the Transfer Engine 20TR residing in the Receiving Node 12T 
of the Connection 18 at predetermined intervals. In a presently preferred embodiment 
of the invention, each sequence of Monitor Packets 12M may contain, for example, 10 
Monitor Packets 12M and sequences will be transmitted at, for example, 2 second 
intervals. The Packet Transfer Engine (PTE) 20TR residing in the Receiving Node 12R 
will reflect or the Monitor Packets 16M back to the Packet Transfer Engine (PTE) 20T 
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residing in the Sending Node 12S. The Pacl^et Transfer Engine (PTE) 20TS will extract 
fWonitor Packet 16M transmission characteristics directly representing the network 
condition of the Connection 18 from the returned or echoed IVIonitor Packets 12M, will 
determine the network conditions of the Connection 18, such as available bandwidth, 
latency and jitter, and will provide the network condition information to a 
Collector/Controller (C/C) 20C, 

[1 33] The transmission and reflection of Monitor Packets 12M may be employed in the 

acquisition of network condition information, for example, during the "bursty" 
transmission of Data Packets 12D, that is, in the intervals between the transmission of 
Data Packets 1 2D. In further example, the transmission and reflection of Monitor Packets 
12M may be employed during a preliminary or initial acquisition of network condition 
information, as will be discussed further below, to acquire network condition information 
to be used in training a neural network implemented in Network Analyzer 48, or during 
operation of an Adaptive Packet Mechanism 20 in transmitting data to acquire network 
condition information for use in updating or modifying a neural network implemented in 
Network Analyzer 48. As will also be described below, the transmission and reflection 
of Monitor Packets 12M may further be used to obtain network condition information for 
use in the design of fuzzy logic used in a Network Analyzer 48. 

[134] Further with respect to this mode of operation, and as discussed below, the 

Packet Transfer Engine (PTE) 20TR residing in the Receiving Node 12Rmay extract and 
store network condition information pertaining to the Connection 1 8 for archival purposes 
and for subsequent use, and may store this information in the Result Entries 40E of 
Network Condition Records 40R in a Result Database 40, Such information may be 
used, as described below, In acquiring initial or preliminary network condition information 
for training a neural network implemented In the Network Analyzer 48, or for use in 
designing fuzzy logic used in a Network Analyzer 48. In addition, the Packet Transfer 
Engine (PTE) 20TR residing in the Receiving Node 12R may transmit the network 
condition information, that is, the corresponding Result Entry 40E or Network Condition 
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Recx)rd 30R, to the Collector/Controller (C/C) 20C as it is acquired, that is, in real time, 
to be used in updating or modifying a neural network implemented in the Network 
Analyzer 48. 

[1 35] Briefly considering Monitor Packets 1 6M and Data Packets 1 6C and the operation 

of the present invention In general, it has been described herein above that according 
to the present invention the available bandwidth, latency and jitter of a given Connection 
18 is a function of the size of Packets 16 and of the inter-packet interval between 
successive Packets 16, that is, the intervals between Packets 16 that are transmitted 
consecutively through the Connection 18. The method and mechanism of the present 
invention determines the packet size and inter-packet interval that utilizes the maximum 
available bandwidth of the connection most efficiently under current network latency, 
jitter and traffic conditions, thereby maximizing the effective data transfer rate. In this 
regard, it is well known and understood by those of ordinary skill in the arts that a given 
Packet 1 6 is comprised of one or more fields of control bits or bytes, often referred to as 
"header" bits or bytes, used in managing and controlling the network transmission of the 
Packets 16, and one or more fields of data, which are the actual "payload" of a Packet 
16. As such, the size of a Packet 16, that is, the number of bits or bytes contained in a 
Packet 1 6, is comprised of a fixed number, primarily comprised of the control or header 
fields, and a controllable number comprised of the data fields. It has been described that 
an Adiaptive Packet Mechanism 20 controls the size of Packets 16 to be an optimum for 
the current network conditions of a Connection 1 8, and it will therefore be apparent that 
an Adaptive Packet Mechanism 20 does so by controlling the size of the data fields of 
the Packets 16 as the control or header fields are typically determined by the 
communications protocol employed by the Sending Node 12S and Receiving Node 12R. 
The range of Packet 16 sizes will thereby range from a minimum determined primarily 
by the size of the control or header fields of the Packets 16 to a maximum determined 
by the communications protocol employed by the Sending Node 12S and Receiving 
Node 12R 24 executed by Network Interface Mechanism 26 and will include both the 
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control or header fields and the maximum capacity of the data fields. As such, it will be 
understood that within the context of the present invention the size of a Paclcet 16, 
whether a Data Packet 16C or a l\/lonitor Packet 16IVI, will be a function of both the 
control or header fields and the data fields. 

[136] Referring to Fig. 6A, therein is illustrated an exemplary Monitor Packet 16iVI as 

may be used in a presently preferred implementation of this mode of operation. In the 
presently preferred embodiment, the Packet Transfer Engine (PTE) 20TS will transmit 
a sequence of 10 (ten) such Monitor Packets 12M, to allow the Adaptive Packet 
Mechanism 20 to obtain information pertaining to, for example, the average available 
bandwidth of the Connection 18 and the average jitter between Packets 16 over the 
Connection 1 8 over a sample of Monitor Packets 1 2M, and information pertaining to the 
extent the Packets 16 may arrive in a sequence that is out of order from the sequence 
in which they were transmitted. It must be noted that Fig. 6A illustrates, in particular, the 
data fields or "payload" of a Monitor Packet 16M, which in a presently preferred 
embodiment is referred to as a "28 byte packet". As shown in Fig. 6A, and for example, 
a Monitor Packet 16M may include a Departure Time 12MT representing the time of 
departure of the Monitor Packet 16M from the Packet Transfer Engine (PTE) 20T, a 
Packet Size 1 6MS representing the size of the Monitor Packet 1 6M, and Packet Number 
16MN representing the sequential position of the Monitor Packet 16M In a sequence of 
Monitor Packets 16M. A Monitor Packet 16M may also include a Transmission 
Parameters 16MP, which may be comprised, for example, of the current Packet Control 
36 representing the currently determined or predicted Optimum Packet Size 36S and 
Optimum Inter-Packet Interval 361. 

[137] As described, the Monitor Packets 1 6M of the sequence of Monitor Packets 1 6M 

transmitted from the Sending Node 12S to the Receiving Node 12R are reflected or 
echoed back to the Sending Node 12S by the Packet Transfer Engine (PTE) 20TR as 
they are received by the Packet Transfer Engine (PTE) 2GTR, that is, immediately upon 
being received, or a rapidly as feasible, and in the order in which they are received. The 
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Packet Transfer Engine (PTE) 20TS may determine the times and sequence of arrival 
of the reflected or echoed Monitor Packets 16M returned fronn the Packet Transfer 
Engine (PTE) 20TR and will extract and determine Network Conditions 42, The Packet 
Transfer Engine (PTE) 20TS will provide Network Conditions 42 to the 
Collector/Controller (C/C) 20C, and, as described below, the Collector/Controller (C/C) 
20C will determine a current Packet Control 36 representing the currently determined or 
predicted Optimum Packet Size 36S and Optimum Inter-Packet Interval 361 from the 
Network Conditions 42. 

[1 38] In one embodiment of Adaptive Packet Mechanism 20, Network Conditions 42 will 

include information pertaining to or representing, for example, such factors as the 
average available bandwidth of the Connection 18, jitter values for the Connection 18, 
and the occurrence or percent of Packets 16 that were received out of order, with these 
factors being determined for the interval in which the iVIonitor Packets 16M were 
transmitted and received back over the Connection 18. For example, Network Conditions 
42 may include, for example, Average Available Bandwidth 42A, Average Jitter 42B, 
Maximum Jitter 42C, Minimum Jitter42D, Packet Order Number Causing Maximum Jitter 
42E and Packet Order Number Causing Minimum Jitter 42F. 

[139] In this embodiment, Average Available Bandwidth 42A is determined as the total 

number of bytes communicated in the sequence of Monitor Packets 12M divided by one 
half of the round trip interval required for the sequence of Monitor Packets 12M to be 
sent from the Packet Transfer Engine (PTE) 20TS and the returned Monitor Packets 
12M of the sequence of Monitor Packets 12M to be received by the Packet Transfer 
Engine (PTE) 20TS. The average round trip latency of the Connection 18 may, in turn, 
be determined as the average of the differences between the departure time of each 
Monitor Packet 12M from the Packet Transfer Engine (PTE) 20TS and the arrival time 
of the returned Monitor Packet 12M at the Packet Transfer Engine (PTE) 20TS, and the 
one way latency of the Connection 18 may be determined as one half of the round trip 
latency. The jitter of each Monitor Packet 12M may be determined by a number of 
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methods. For example, the expected arrival time of each Monitor Packet 12M for zero 
jitter can be determined from the departure time of each Monitor Packet 12M from 
Packet Transfer Engine (PTE) 20TS and the average round trip latency of the 
Connection 18. The expected arrival time of each Monitor Packet 12M may then be 
compared with the actual arrive time of each Monitor Packet 1 2M at the Packet Transfer 
Engine (PTE) 20TS, and one half of this difference will represent the jitter for that 
individual Monitor Packet 12M. It will also be noted that jitter, which is the packet to 
packet variation in latency through the Connection 18, may also be determined relatively 
by determining the interval between the arrivals of successive packets and comparing 
these measured values to the inter-packet Interval specified in the Monitor Packet 12M. 
The Average Jitter 42B, in turn, may be determined as the average of the individual jitter 
values, and the Maximum Jitter 42C and Minimum Jitter 42D as the maximum and 
minimum of the individual jitter values. Finally, the Packet Order Number Causing 
Maximum Jitter 42E and Packet Order Number Causing Minimum Jitter 42F may be 
determined from the Packet Numbers 12MC of the Monitor Packets 12M having the 
Maximum Jitter 42C and Minimum Jitter 42D values. 

In another and presently preferred embodiment of the invention, the Network 
Conditions 42 may be comprised of or include 2-Way Delay Maximum 42G, 2-Way Delay 
Minimum 42H, 2-Way Delay Average 421, Jitter Average 42J, Number of Packets Out 
of Sequence 42K and Number of Packets Lost 42L. It will be noted that these values are 
similar to or are derived in a manner similar to those of Network Conditions 42A through 
42F, except that the delays or times are determined in terms of the round trip times from 
Packet Transfer Engine (PTE) 20TS to Packet Transfer Engine (PTE) 20TR and back 
to Packet Transfer Engine (PTE) 20TS, rather than one half of these times. It will also 
be noted that the bandwidth of the Connection 18 is represented indirectly as a 
maximum and minimum latency for the round trip as the number of bytes transferred 
during these periods is known, and that jitter is represented by the average jitter only 
rather than also be the maximum and minimum jitters. Another difference is that changes 
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in the order of packets during transmission over the Connection 18 is represented by the 
number of packets that are out of order rather than by values representing the packets 
having the maximum and minimum jitters, and in that the Network Conditions 42 now 
include the number of packets lost. 

[141] It should be noted that fn other implementations of Packet Transfer Engines (PTE) 

20T and Collector/Controller (C/C) 20C, the Packet Transfer Engines (PTE) 20TS will 
perform basic measurement operations, such as reading departure time and packet 
sequence number information from IVIonitor Packets 12IVI and determining the arrival 
times of the returned Monitor Packets 12M, The Packet Transfer Engine (PTE) 20TS will 
provide the basic measurement information to the Collector/Controller (C/C) 20C, which 
will perform the operations to extract or determine Network Conditions 42. such as 
Average Available Bandwidth 42A, Average Jitter 42B, Maximum Jitter 42C, Minimum 
Jitter 42D, Packet Order Number Causing Maximum Jitter 42E and Packet Order 
Number Causing Minimum Jitter 42F. 

[142] It must be also noted with regard to the determination of Network Conditions 42 

that in the present embodiment of this mode of operation such network condition values 
as latency, jitter and available bandwidth are determined with respect to "round trip" 
times. That Is, and for example, bandwidth and latency are determined with respect to 
one half of the round trip intervals or times for the Monitor Packets 1 2M to be transmitted 
through the Connection 18 and returned through the Connection 18. It is therefore 
assumed that the latency and jitter of the transmission path through a Connection 18 is 
equal in both directions of transmission, or is sufficiently equal for purposes of the 
present invention. In this regard, it must be noted that the clocks residing in the Sending 
Node 12S and Receiving Node 12R of a Connection 18 are typically not synchronized, 
or at least are not synchronized to the degree of accuracy required to measure 
differences or changes in latency and jitter. The determination of latency and jitter 
through a Connection 18 by determining the departure and arrival times of Monitor 
Packets 12M at the Packet Transfer Engine (PTE) 20TS, that is, at a single end of the 
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Connection 18, thereby obviates or alleviates the problem of non-synchronization 
between the Sending Node 12S and Receiving Node 12R clocl^s by using only a single 
clock for all measurements. It will be further noted that this method is in accordance with 
a basic principle of the present invention, that is, treating a Connection 18 and all 
elements of a Connection 18 as a "black box" for purposes of determining the optimum 
packet size and inter-packet interval to make optimum use of the available Connection 
18 bandwidth. 

[143] c. Network Condition Acquisition, Condition Records 40R and Test 

Result Entries 40 E 

[144] It has been described herein above that the Packet Transfer Engine (PTE) 20TR 

residing in the Receiving Node 12R may extract and store network condition information 
pertaining to the Connection 18 for archival purposes and for subsequent use, and may 
store this information as a set of Test Result Entries 40E in a Network Condition Record 
40R In a Result Database 40. An exemplary Network Condition Record 40R is illustrated 
in Fig. 6C, wherein it will be seen that a Condition Record 40R may include, and for 
example, Network Test Result Fields 44A through 44AC. It will be noted that the values 
or Information contained In each of Network Test Result Fields 44A through 44AC are 
defined in the exemplary Network Condition Record 40R shown In Fig. 6C. It will further 
be noted that certain of the values or infomriatlon residing in Network Test Result Fields 
44A through 44AC are the same as or similar to those determined for Network 
Conditions 42. 

[145] The determination of these and other values and information contained in Network 

Test Result Fields 44A through 44AC will be apparent to those of ordinary skill in the 
relevant arts, with the assistance of the definitions of the values and contents of the 
fields provided in Fig. 6C. and therefore will not be discussed further herein. In this 
regard, and as discussed above, it must be noted that the clocks residing in the Sending 
Node 12S and Receiving Node 12R of a Connection 18 are typically not synchronized, 
or at least are not synchronized to the degree of accuracy required to measure 



wo 02/101513 



PCT/US02/18864 



-55- 

differences or changes in latency and jitter. Certain values, however, such as jitter, which 
is the packet to packet variation in latency through the Connection 18, may be 
determined relatively by determining the interval between the arrivals of successive 
packets and comparing these measured values to the inter-packet interval specified in 
the iVIonltor Packet 1 2M. Other Test Result Field 44 values or information, however, may 
be more readily determine at the Packet Transfer Engine (PTE) 20TR end of a 
Connection 18 than at the Packet Transfer Engine (PTE) 20TS end of the Connection 
18. For example, the Monitor Packet 12M will identify the number of Monitor Packets 
12M In the test sequence, and the number of packets received or number of reads or 
attempted reads to a socket or number of lost packets are more accurately determined 
by the Packet Transfer Engine (PTE) 20TR as the possibility of a lost or erroneous 
packet during the retum transmission is eliminated. It will also be noted that Test Result 
Fields 44 include values or information not obtained by the Packet Transfer Engine 
(PTE) 20TS, such as the trend in delay or jitter times, while may be obtained by 
comparison of the arrival times of Monitor Packets 12M at the Packet Transfer Engine 
(PTE) 20TR and are not dependent upon synchronization between the Sending Node 
12S and Receiving End 12R clocks. 

[146] The network condition information acquired in and by the Packet Transfer Engine 

(PTE) 20TR may be used in a number of ways. For example, Monitor Packets 12M may 
be transmitted through one or more Connections 1 8 as described above during an initial 
or preliminary period before startup or initialization of the full, in-use operation of an 
Adaptive Packet Mechanism Network 20 to acquire network condition information about 
the Connections 1 8. The stored Condition Records 40R and Result Entries 40E collected 
in a Result Data Base 40 may then be used, for example, for the initial training of a 
neural network implemented in the Network Analyzer 48, or in the design of a fuzzy logic 
analyzer implemented in the Network Analyzer 48. 

[147] The network condition information acquired in and by a Packet Transfer Engine 

(PTE) 20TR through the transmission of Monitor Packets 12M as described above, that 
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is, the Condition Records 40R or Result Entries 40E may also be transmitted to the 
Collector/Controller (C/C) 20C in real time, that is, during operation of the Adaptive 
Packet Mechanism 20 in transmitting Data Packets 12D from a Sending Node 12S to a 
Receiving Node 12R. As described, these Monitor Packets 12M may be transmitted, for 
example, during "bursty" transmissions in the Intervals when Data Packets 12D are not 
being transmitted, thereby allowing the acquisition of network condition information by 
the Packet Transfer Engine (PTE) 20TR In real time and during the use of the Adaptive 
Packet Mechanism 20 to transmit Data Packets 12D, so that the information in the 
Condition Records 40R or Result Entries 40E represents current conditions in the 
network. This information may then be used to update or modify, for example, a neural 
network implemented in the Network Analyzer 48 so that the operations of the neural 
network are continuously updated to reflect current conditions in the network. It should 
be noted that the "real time" collection of network condition information by a Packet 
Transfer Engine (PTE) 20TR, the information may be transmitted to the 
Collector/Controller (C/C) 20C at the conclusion of the sequence of Monitor Packets 
16M, or as each Monitor Packet 12M is received. 
[148] d. Network Conditions Acquisition, Continuous Transfer 

[149] As discussed above, an Adaptive Packet Mechanism 20 may execute continuous 

data transfers, such as the transfer of audio/video data, wherein the Connection 18 is 
essentially completely occupied in transferring Data Packets 1 2D for extensive periods. 
This mode is similar in may respects to the network condition acquisition modes 
described above, except that the network condition information is extracted from the 
transmission characteristics of the Data Packets 1 2D rather than from Monitor Packets 
12M, although Monitor Packets 12M may be transmitted and used in, for example, 
intervals between or pauses in the transmission of the Data Packets 12D. In general, 
however, the network condition information represented in a Condition Record 40R or 
Result Entry 40E will be extracted or determined in the same manner as in the first and 
second test modes described above. For example, the Data Packets 12D will typically 
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include information identifying the number of bytes contained therein, departure time, 
and so on. Other values, such as inter-packet interval, may be obtained from Control 
Outputs 38C or may be averaged values determined from the arrival times of Data 
Packets 1 2D and jitter measurements may be determined as in the first and second test 
modes. It should be noted, however, that in this mode the information represented in 
Condition Records 40Rwill be the primary source of network condition information 
provided to the Collector/Controller (C/C) 20C, rather than information acquired at the 
Packet Transfer Engine (PTE) 20TS. It should also be noted that certain network 
condition values or information may be ascertained, for example, either as periodic 
samples, such as for successive groups often Data Packets 12D, or a "running window" 
values that are updated for each new received Data Packet 12D. 
[150] e. Single Ended Operation 

[151] Lastly, and as indicated in Fig. 6A, an Adaptive Packet Mechanism 20 may be 

implemented in a "single ended" configuration which does not require a Packet Transfer 
Engine (PTE) 20TR in the Receiving Node 12R. Instead, and as indicated in Fig. 6A, the 
essential or basic functions of the Packet Transfer Engine (PTE) 20TR are implemented 
through and by the ICMP of the Intemet Protocol Layer 28J of the TCP/IP Model 24T, 
as illustrated in Fig. 4. As is well known to those of ordinary skill in the relevant arts, the 
ICMP of a Node 12 receiving a Packet 16 performs a "ping" function by transmitting an 
acknowledgment of a received Packet 16 to the Node 12 transmitting the Packet 16. In 
this mode of operation, therefore, each Monitor Packet 12M or Data Packet 12D 
transmitted by the Packet Transfer Engine (PTE) 20TS of a Sending Node 12S will be 
acknowledged by an acknowledgment from the ICMP of the Receiving Node 12R. The 
receipt of an ICMP acknowledgment for each Monitor Packet 12M or Data Packet 12S 
will therefore allow the Packet Transfer Engine (PTE) 20TS to determine such Network 
Conditions 42 as the latency of the Connection 18, as the round trip time of the 
transmitted Packet 16 plus the time required for return of the acknowledgment, and from 
this information such Network Conditions 42 as the jitter of each Packet 16, in a manner 
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similar to that described above with regard to Monitor Packets 1 2M. Depending upon the 
Connection 18 and other factors, it may be possible to also determine such factors as 
the order in which the Pacl<ets 16 are received by the Receiving Node 12R, It will be 
noted, however, that this method will not generate, for example, the network condition 
Information described above with regard to Condition Records 40R or Result Entries 
40E. As a consequence, this method is difficult to implement with a neural network 
based Network Analyzer 48 is there will typically be insufficient network information, 
either as a historic record or in real time, to train or update a neural network. As such, 
this method Is preferable implemented with a Network Analyzer 48 based upon a fuzzy 
logic analyzer, as described in a following discussion. 

[152] In summary, therefore, an Adaptive Packet Mechanism 20 may operate in a 

number of modes, including, for example: 

[153] (a) The data transfer mode wherein Data Packets 12D are transmitted in 

either a continuous mode or a bursty mode and wherein the packet sizes and inter- 
packet intervals are determined by network conditions, including Connection 18 latency 
and jitter and available bandwidth but also possibly including such factors as packet loss, 
and the amount and type of data to be transferred. 

[1 54] (b) A reflected Monitor Packet 1 2M mode wherein Monitor Packets 1 2M are 

transmitted during an initial network condition information acquisition period to generate 
Condition Records 40R and Result Entries 40E to be used in the initial training of a 
neural network in Network Analyzer 48. 

[155] (c) A reflected Monitor Packet 1 2M mode wherein Monitor Packets 12M are 

transmitted during operation of the Adaptive Packet Mechanism 20 to generate Condition 
Records 40R and Result Entries 40E to be returned in real time to the 
Collector/Controller (C/C) 20C to be used in the updating or modification of a neural 
network in Network Analyzer 48 according to current network conditions. 
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[1 56] (d) A reflected Monitor Packet 1 2M mode wherein Monitor Packets 1 2M are 

transmitted during operation of tlie Adaptive Packet Mecfianism 20 to generate Network 
Condition 42 during operation of the Adaptive Packet Mechanism 20. 

[157] (e) A continuous transmission mode wherein Condition Records 40R and 

Result Entries 40E are generated In real time from the observed transmission 
characteristics of Data Packets 12D transmitted by the Packet Transfer Engine (PTE) 
20TS and are returned in "real time" to the Collector/Controller (C/C) 20C. This 
information may be used, for example, in the updating or modification of a neural 
network in Network Analyzer 48 according to current network conditions or in the same 
manner as Network Conditions 42. 

[158] (f) A "single ended" mode similar to the reflected Monitor Packet 12M 

modes but wherein the basic functions of the Packet Transfer Engine (PTE) 20TR are 
performed by the "ping' or acknowledgment function of the ICMP of the Internet Protocol 
Layer 28J of the TCP/IP Model 24T. 

[1 59] It must be noted with respect to the above summarized modes of operation of an 

Adaptive Packet Mechanism 20 that the various modes of operation may be interleaves, 
as when the data transfer mode is interleaved with the reflected Monitor Packet 12M 
mode during a "bursty" data transfer. Certain of the modes of operation may be 
performed alone, however, as when a reflected Monitor Packet 12M mode is used to 
generate Condition Records 4GR and Result Entries 40E for use in training a neural 
network, or when the data transfer mode is used alone in the continuous transmission 
mode. 

[160] e. Description of Collector/Controller (C/C) 20C (Fig- 6A) 

[161] As indicated in Fig. 6A, information representing the current network packet 

transmission characteristics or properties of a Connection 18 are provided to 
Collector/Controller (C/C) 20C, together with information pertaining to a present data 
transfer to be executed, and Collector/Controller (C/C) 20C in return generates a Packet 
Control 36 output indicated the present Optimum Packet Size 36S and Optimum Inter- 
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Packet Interval 361. As discussed above, the current network packet transmission 
characteristics may be provided as Network Conditions 42 from Packet Transfer Engines 
(PTE) 20TS or as a Condition Record 40R or as Condition Record Entries 40E from the 
Packet Transfer Engine 20TR. As shown, information pertaining to the current request 
for a data transfer Is contained in a Transfer Request 46 from a Data Source 22S, which 
identifies, for example, the type of data transfer requested and the amount of data to be 
transmitted. In this regard, it should be noted that a Transfer Request 46 may be 
submitted by a Sending Node 12S, either at its own initiative or in response to a request 
from a data request from a Receiving Node 12R or may be submitted by a Receiving 
Node 12R as part of a data request to a Sending Node 12S. In either instance the 
Packet Control 36 outputs will be provided to the Sending Node 12S and possibly to the 
Receiving Node 12R, depending upon the type of data transfer to be performed. 
[162] It will be apparent from the above discussions that Network Conditions 42 directly 

or indirectly represent a significant number of network variables and that the relationship 
of these variables to the current optimum packet size and inter-packet interval is 
complex, often nonlinear and variable with time. In addition, and as a consequence, the 
number of possible combinations of values of these network variable will be extremely 
large. In addition, and according to the present Invention, it is necessary for the Adaptive 
Packet Mechanism 20, and in particular the Network Analyzer 48, to be able to 
determine the optimum packet size and inter-packet interval for current connection 
conditions in "real time" because of the rapid variability of connection transmission 
conditions. 

[163] There are, however, a number of methods for determining solutions to problems 

having large number of complexly related variables and that will meet the requirements 
and needs of an Adaptive Packet Mechanism 20 of the present invention, many of which 
will be well known to those of ordinary skill in the relevant arts. For example, two of these 
methods are referred to as "fuzzy logic" and "neural networks", each of which have 
different characteristics and advantages and disadvantages and each of which may be 
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used for the functions performed by an Adaptive Packet Mechanism 20. As will be 
described below, and as illustrated in Fig. 6A, a Collector/Controller (C/C) 20C of the 
present Invention may include or be functionally associated with Network Analyzer 48 for 
determining the current packet size and inter-packet Interval for a given set of current 
Network Conditions 42 and a current Transfer Request 46. A Network Analyzer 48 may 
be implemented by a variety of methods and mechanism, depending upon the 
requirements for a given Collector/Controller (C/C) 20C. Collector/Controller (C/C) 20C 
may include of be associated with, for example, a Fuzzy Logic Analyzer 48A, a Neural 
Network 48B or a Combined Analyzer 48C including a Fuzzy Logic Analyzer 48CA and 
a Neural Network 48CB. Each of these implementations will be discussed below but, as 
each of these methods are well known to those of ordinary skill in the relevant arts, each 
will be described only briefly. 
[164] First briefly considering fuzzy logic, fuzzy logic is a method for determining the 

degree to which an entity represented by a set or subset of characteristics is a member 
of a group as a function of the values of the characteristics. A fuzzy logic system may be 
conceptualized as a multidimensional space wherein each dimensional axis of the space 
corresponds to a characteristic and wherein the groups are defined as regions of the 
multidimensional space and wherein the regions may be exclusionary or may overlap to 
any degree. In identifying the degree to which a given set or subset of the characteristics 
is a member of one or more groups, the multidimensional space is indexed along each 
axis corresponding to a characteristic of the set or subset and by the value of each 
characteristic of the set or subset. The point identified in the space by the intersection 
of the values of the characteristics identifies the location of the set or subset of 
characteristics with respect to the defined regions, and thereby the degree to which the 
set or subset of characteristics is a member of one or more of the regions. In the present 
instance, the set or subset of characteristics are defined by some or all of Network 
Conditions 42 and the group is one or more of the classifications or categorizations of 
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the network or connection condition as uncongested, moderately congested or 
congested. 

[1651 A Fuzzy Logic Analyzer 48A is advantageous in tliat fuzzy logic systems are 

relative efficient and require relatively little processing resources of a system and are 
relatively fast, tliat is, the time between providing characteristic value inputs and a 
receiving an output indicating degrees of group membership is relatively short. A 
disadvantage is that fuzzy logic systems inherently and customarily have no learning or 
adaptation facilities, and are thereby less suited to systems in which the values or ranges 
of characteristic values or of the membership regions change over time. Essentially, 
fuzzy logic systems cannot be "trained" over time, or "learn" as circumstances change, 
but must be updated by redefinition of the membership regions, and possibly by 
reconstruction of the system. Fuzzy logic systems are thereby most efficient and 
effective in smaller systems and in systems In which the characteristic values or ranges 
of values and the membership regions do not change extensively with time. 

[166] Neural Networl<s 48B, in contrast, are specifically developed and designed as 

systems that may perform many of the same functions as fuzzy logic systems, that is, 
generating outputs representing decisions based upon input information, but have the 
capability of "learning", or of being "trained", both initially and over time. 

[167] A neural network is essentially a decision making system or process modeled 

loosely on the human brain and is functionally comprised of neuron functions organized 
in layers and linked in various configurations to adjacent neurons in the same layer and 
to neurons in higher or lower layers. Each neuron is capable of performing certain 
defined and limited logic and decision making operations upon input information, which 
may be input information or an output of a lower layer neuron or a neighbor neuron of 
the same level, and of passing the results of these operations to subsequent neurons or 
as output signals. Neural networks are "taught" or "trained" by changing of the "weights" 
of the inter-neuron connections, wherein the "weights" are retained in the neurons and 
thereby effectively comprise a "memory" of the training or "experience". There are 
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various forms and methods of training neural networks and the presently preferred 
embodiment of a Neural Network 48B employs the method refen-ed to as "back 
propagation" wherein the network is provided with both reinforcement for correct 
decisions and error information, both of which are used to adjust the connections and 
connection weights between neurons. Lastly, it should be noted that neural networks 
may be designed for both "off line" and "on line" learning. In this regard, when a neural 
network is using input information to change the neuron interconnection weights, the 
network is said to be in "learning" or "training" mode and, when the network is operating 
to generate decisions based on the input information, the network is said to be in the 
"operation" or "recall" mode. In "offline" training, the neuron interconnection weights are 
fixed, that is, do not change, during operation or recall node, so that the basis for 
decisions does not change in operation mode. In "on line" training, the neuron 
interconnection weights may change during the operation node, so that the network 
"learns" dynamically as it is making decisions. 
[168] Neural Networks 48B are relatively expensive in system resources and are 

relatively slow to train. However, because of their capability for learning and adapting, 
Neural Networks 48B are advantageous in larger and more complex Network Systems 
10 where the membership regions of a Fuzzy Logic Analyzer 48A may be difficult to 
define initially and in systems wherein the values or ranges of values of the input 
characteristics or the ranges of required decisions are expected to change significantly 
over time. 

[169] Lastly, it is illustrated in Fig. 6A that one preferred embodiment of a 

Collector/Controller (C/C) 20C is implemented with an associated Combined Analyzer 
48C comprising a Fuzzy Logic Analyzer 48CA and a Neural Network 48CB operating in 
conjunction. In this embodiment, Fuzzy Logic Analyzer 48CA is essentially functionally 
incorporated into Neural Network 48CB and is initially configured for the anticipated 
conditions and characteristics of transmission in the Connections 18 of Network 10. As 
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will be discussed below, Fuzzy Logic Analyzer 48CA will thereby provide the Initial 
training "knowledge" for Neural Network 48CB. 

[170] In operation, Fuzzy Logic Analyzer 48CA and a Neural Network 48CB receive 

either or both of Network Conditions 42 and Condition Records 20R from either or both 
of Packet Transfer Engine (PTE) 20TS and Packet Transfer Engine (PTE) 20TR, 
depending upon the type of current data transfer and the cun*ent test mode employed 
and will receive Transfer Requests 46. The Combined Analyzer 48C will, in turn, 
generate Packet Control 36A outputs identifying an Optimum Packet Size 36S and an 
Optimum Inter-Packet interval 361 and will provide the Packet Control 36A outputs to the 
Collector/Controller (C/C) 20C. Collector/Controller (C/C) 20C will, in turn, provide the 
Packet Control 36 outputs to either or both of the involved Packet Transfer Engine (PTE) 
20TS and Packet Transfer Engine 30TR. 

[171] In the initial stages of operation, that is, before Neural Network 48CB has been 

trained to the current Connection 18, the Packet Control 36 outputs of Fuzzy Logic 
Analyzer 48CA will be used, together with the Network Condition 42 information from 
either or both of Packet Transfer Engine (PTE) 20TS and Packet Transfer Engine (PTE) 
20TR, to train Neural Network 48CB. Thereafter, Fuzzy Logic Analyzer 48CA and Neural 
Network 48CB will generate Packet Control 36 outputs in response to Network Condition 
42 Inputs from Packet Transfer Engine (PTE) 20TS and Packet Transfer Engine (PTE) 
20TR. 

[1 72] In this regard, the Packet Control 36A outputs of Fuzzy Logic Analyzer 48CA will 

be the primary control inputs to Collector/Controller (C/C) 20C during those periods when 
the data transmission characteristics and conditions of Network 10 and Connection 16 
are relatively stable because of the generally faster response of Fuzzy Logic Analyzer 
48CA, that is, during those periods during which the ranges of values of Network 
Conditions 42 and Condition Records 40R are relatively stable. Should the Network 10 
or Connection 16 conditions and characteristics change beyond the effective range of 
response of Fuzzy Logic Analyzer 48CA. as will be indicated by an increase in the 
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latency or jitter experienced by Packets 16, the Packet Control 36A outputs of Neural 
Network 48CB will assume control of Collector/Controller (C/C) 20C. It will be 
appreciated that this changeover of control from Fuzzy Logic Analyzer 48CA to Neural 
Network 48CB may be implemented in a number of ways, such as an Internal logic 
disabling of the outputs of Fuzzy Logic Analyzer 48CA should the latency or jitter 
experienced by Packets 16 of Monitor Packets 16M exceed a predetennined limit, as 
reflected in Network Conditions 42 or Condition Records 40R. In this case, Neural 
Network 48CB will both generate the controlling Packet Control 36A outputs and will 
enter a self-learning mode wherein the learning processes of Neural Network 48CB 
adapt to the new transmission conditions and characteristics of Network 10 and 
Connections 18. During this time, Neural Network 48CB will generate Update SOU 
outputs to Fuzzy Logic Analyzer 48CA , wherein the Update SOU inputs will be used by 
Fuzzy Logic Analyzer 48CA to update the sets and subsets of network characteristics 
and defined membership regions therein until the performance of Fuzzy Logic Analyzer 
48CA is comparable with that of Neural Network 48CB. It will be understood that this 
reverse changeover of control will typically occur some time after the data transmission 
characteristics and conditions of Network 10 and Connection 16 have once again 
become relatively stable. At this time, Fuzzy Logic Analyzer 48CA may assume primary 
control of Collector/Controller (C/C) 20C. 

Considering a present example of a back propagation neural network as may be 
implemented as a Neural Network 48B or as a Neural Network 48CB in a Combined 
Analyzer 48C, such a neural network may be implemented in three layers, respectively 
designated as the input layer, the middle layer and the output layer. The input layer 
receives as inputs variable representing and comprising the information from which the 
neural network is to generate Packet Control 36A outputs and these variables will 
preferably comprise the minimum number of variable necessary to predict an Optimum 
Packet Size 36S and an Optimum Inter-Packet Interval 361. In a present embodiment, 
for example, the input layer may receive the information regarding transfer type and 
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volume of data from a Transfer Request 46. The middle layer, in turn, is comprised of 
weighted neurons to perform the majority of operations necessary to determine the 
Optimum Pacl<et Size 36S and Optimum Inter-Packet 361 values, while the output layer 
generates the actual Optimum Packet Size 36S and Optimum Inter-Packet 361 values 
as a Packet Control 36 output. Other inputs to the neural network will typically include 
training input, such as Network Conditions 42 and Condition Records 40R representing 
the performance, condition and characteristics of the Connection 16. These inputs 
comprise a criteria by which the neural network may evaluate the generation of the 
Packet Control 36A outputs, and by which the neural network may "learn". 

[174] Lastly, it will be understood by those of ordinary skill in the relevant arts that an 

Adaptive Packet Mechanism 20 may perform the above described operations for a 
plurality of Connections 18 concurrently, each comprising a transmission path through 
a Network 10 between a Sending Node 12S and a Receiving Node 12R. In other 
embodiments, and depending upon the configuration of the implementation of an 
Adaptive Packet Mechanism 20, the Sending Nodes 12S and Receiving Nodes 12R of 
a Network System 10 may include a plurality of Adaptive Packet Mechanisms 20, each 
operating between one or more pairs or groupings of Sending Nodes 1 2S and Receiving 
Nodes 12R and managing one or more Connections 18. Lastly, and as described, a 
Collector/Controller (C/C) 20C need not reside in a Node 12 containing a Packet 
Transfer Engine (PTE) 20T, but may reside in a Node 12 separate from Sending Nodes 
12S and Receiving Nodes 12R. 

[175] 3. Exemplary Implementations and Applications of Adaptive Packet 

Mechanisms 20 (Figs. 7A and 7B) 

[176] Having described the structure and operation and at least some implementation 

contexts of the methods and apparatus of the present invention, and in particular as 
various embodiments and implementations of Adaptive Packet Mechanisms 20, the 
following will next discuss and describe certain specific exemplary implementations of 
the present invention. 
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[177] For example, and referring to Fig. 7A, therein is illustrated an implementation and 

embodiment of the present invention as a Packet Groomer 50 operating in a networked 
system to dynamically optimize the sizes of packets transferred between various 
application programs residing in the Nodes 12 of a Network 10. A Packet Groomer 50 
is typically implemented to optimize packet transfer in, for example, 802.1 1 (b) or 802.1 1 
wireless local area networks operating, for example, in the 2.4 GHz band, thereby 
improving data throughput, range and power consumption of the IP connection. As 
Illustrated in Fig. 7B, such connections may be implemented, for example, to connect 
devices such PCs, laptops, palmtops, or PAs to similar devices, to server systems or to 
other data communications systems through, for example, cell phones and cell phone 
networks. 

[178] As will be seen from the following discussions, the implementation of the present 

invention as a Packet Groomer 50 is particularly well adapted to 802.11 type systems, 
for example, as the delivery of data fragments, that is, packets containing fragmented 
data, is guaranteed through the Distributed Controlling Functionality (DCF) feature of 
such systems, wherein DCF is an Automatic Repeat Request (ARQ) functionality based 
on the MAC layer delivery protocols. As such, when a given fragment is "lost", only that 
fragment need be retransmitted, whereas in 802.3 (Ethernet) MAC environments the 
delivery of fragments is not guaranteed so that the retransmission of all of the fragments 
of a transmission is required if a single fragment is "losf , thereby significantly effecting 
the efficiency of the system. 

[179] As illustrated In Fig. 7A, Application Programs (Applications) 52S and 52R 

residing respectively in an Adaptive Node 1 2A and in a Passive Node 1 2P communicate 
through a Connection 18 of the Network 10 and through the respective Network Protocol 
Stacks (Stacks) 24 residing in the Nodes 12 for this purpose. For purposes of the present 
description of a Packet Groomer 50, and for reasons that will be described in the 
following, Adaptive Node 12A is referred to as the "active" Node 12 because the Packet 
Groomer 50 resides in the Adaptive Node 12A and "grooms" or "adapts" the sizes of the 
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Packets 16 transmitted from this node to the optimum packet size for the Connection 18 
and cunrent packet transmission conditions of Connection 18. In contrast, and again as 
described in further detali in the foiiowing, Passive Node 12P does not contain any 
elements of a Packet Groomer 50 but is instead a conventional and nonmaliy operating 
Node 12. The Passive Node 12P, however, will automatically adapt to the packet sizes 
determined by the Adaptive Nodes 1 2P by normal operation of the Stack 24 therein and 
will automatically adapt to use the optimum packet sizes as determined by the Adaptive 
Nodes 12A, so that a Passive Node 12P is a passive partner to the Adaptive Node 12A. 
£180] As described in detail previously with respect to Figs. 3 and 4 and in the 

descriptions and discussions pertaining thereto, each Stack 24 is comprised of a plurality 
of functional Layers 28 wherein the specific functions, purposes, structures and 
operations of each Layer 28 will depend upon the network protocol or protocols 
implemented therein and upon the functions and operations required of each Stack 24. 
For purposes of the present description, however, a Stack 24 may be represented as 
typically including a Protocol Stack 24 and a Device Driver 54D and associated Network 
Interface 541 through which the Application 52 and Protocol Stack 24 communicate with 
the Connection 18 and another Node 12 with which the Application 52 is transferring 
Packets 16. In this regard, it should be noted that Network Interface 541 is typically 
comprised of hardware circuitry for driving signals to and receiving signals from a 
Connection 18 while Device Driver 54D is typically comprised of routines, programs and 
protocols controlling the Network Interface 541. Also, either Device Driver 54D or Network 
Interface 541 or both may be regarded as components of the Stack 24, but are illustrated 
as individual components herein for purposes of the present discussions. Typical 
implementations of a Device Driver 54D and of a Network interface 541 may also found 
herein in association with the descriptions of Layers 28A, 28B, 28K and 28J shown In 
Figs. 3 and 4. 

[181] It has been described previously that an Adaptive Packet Mechanism 20 of the 

present invention typically includes a Communications/Controller (C/C) 20C for 
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monitoring and gathering information regarding the transfer of packets through a 
Connection 18, a Networl< Analyzer 48 to determine the optimum packet size for 
transfers through the current Connection 1 8, and at least one Packet Transfer Engine 
(PTE) 20T for forming the data to be transferred into packets of the optimum size and 
transferring the packets through the Connection 18. As Illustrated in Fig. 7A, a Packet 
Groomer 50 similarly includes a C/C 20C, a Network Analyzer 48 and a PTE 20T, 
wherein the C/C 20C and the Network Analyzer 48 together function as a Network Agent 
54 to determine and monitor information reflecting the current packet transmission 
characteristics of each Connection 18 that may be accessible to the Adaptive Node 12A. 
As previously described, the C/C 20C probes each Connection 18 that is in current use 
by transmitting ICMP echo packets to the Passive Node 12P and receiving the 
responses from the Passive Node 12P. 

[182] As has been discussed previously herein, the ICMP of a Node 12 receiving a 

Packet 16 performs a "ping" function by transmitting an acknowledgment of a received 
Packet 16 to the Node 12 transmitting the Packet 16. In this mode of operation, 
therefore, each Monitor Packet 12M or Data Packet 12D transmitted by the Packet 
Transfer Engine (PTE) 20T of a Node 12 will be acknowledged by an acknowledgment 
from the ICMP of the Node 12 that received the Packet 16. The receipt of an ICMP 
acknowledgment for each Packet 16, that is, each Monitor Packet 12M or Data Packet 
12D, will therefore allow the C/C IOC operating with the sending Packet Transfer Engine 
(PTE) 20T to determine such Network Conditions 42 as the latency of the Connection 
18, as the round trip time of the transmitted Packet 16 plus the time required for return 
of the acknowledgment and, from this information, such Network Conditions 42 as the 
jitter of each Packet 16, in a manner similar to that described above. Depending upon 
the Connection 18 and other factors, it may be possible to also determine such factors 
as the order in which the Packets 16 are received by the receiving Node 12. 

[183] The use of ICMP acknowledgment or echo packets, or similar systems providing 

a "return echo" for each packet received by a Node 12, to probe a Connection 18 allows 
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the packet transmission characteristics of a Connection 18 to be determined from a 
single end of the Connection 18, that is, from the Adaptive Node 1 2P in which the Pacl^et 
Groomer 50 resides. This feature, together with the operation of the Passive Node 1 2P 
as described below in automatically adapting to the packet sizes transmitted from the 
Adaptive Node 12A, thereby allows the Packet Groomer 50 to be implemented as a 
single-ended configuration, that is, a configuration that does not require any of a C/C 
20C, a Network Analyzer 48 or a PTE 20T at each end of a Connection 18, but only at 
the Adaptive Node 12A end of a Connection 18. 

[184] As also previously described, the packet transmission condition information 

obtained by the C/C 20C is passed to the Network Analyzer 48, which determines the 
current packet transmission characteristics of the current Connection 18 and stores the 
optimum packet size Information for each Connection 1 8 available to the Node 1 2. In the 
present implementation, and for example, the Network Agent 54 is implemented as a 
subsystem WIN32 application that resides in the system "tray" to monitor the system IP 
connections and to determine the packet transmission characteristics of each such 
connection and the Network Analyzer 48 functions are implemented as a neural network, 
also as previously described. 

[185] The PTE 20T, in turn, is implemented as a NDIS Intermediate Driver (NID) 56 

residing between Protocol Stack 24 and Device Driver 54D at the IP Stack 24 fevef and 
in the path of the Packets 16 being transmitted. As indicated in Fig. 7A, the NID 56 is 
connected from and is controlled by the Network Agent 54 in the manner that has been 
previously discussed in detail with respect to C/C 20C, Network Analyzer 48 and PTE 
20T. In particular, NID 56 passes to the Network Agent 54 the IP address of the Node 
12P with which the Node 12A is communicating, and receives in return the optimum 
packet size for the current Connection 18 between the Node 12A and the Node 12P. 

[186] As also shown, NID 56 is connected in the packet output path from Stack 24 to 

Device Driver 54D to intercepts and capture all outgoing packets, referred to herein as 
Slack Packets 24P, generated by the Application 52 and Stack 24 for transmission 
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through the Connection 18. NID 56 fragments the outgoing Stacic Packets 24P from 
Stacic 24 into paci<ets, identified herein as Fragmented Packets 24F, wherein 
Fragmented Packets 24F are of the optimum packet size as determined by the Network 
Agent 54. NID 56 then passes the Fragmented Packets 24F to the Network Interface 541 
for transmission through the Connection 18 and to the Node 12P. As represented in Fig. 
7C, when NID 56 fragments Stack packets 24P into Fragmented Packets 24F, NID 56 
also changes the Fragmentation Fields (FRAGFs) 58F in the IP headers (IPHs) 58H of 
the Packets 24 to Imitate the original OS IP Stack 24 fragmentation that would have 
been present except for the operations of the NID 56, and to instead represent the actual 
fragmentation of the packets according to the optimum packet size as determined by the 
Packet Groomer 50. In this regard, it should be noted that the OS IP Stack 24 will 
fragment the packets only if the packets exceed the size permitted by the Stack 24 MAC 
layer, the packets being otherwise fragmented by the NID 56 and according solely to the 
optimum packet size as determined by the Packet Groomer 50.. 
[187] The NID 56 then passes the Fragmented Packets 24F with the changed 

fragmentation fields to Device Driver 54D, which in turn transmits the packets to the 
Node 12P through Network Interface 541 and the Connect/on 18. As illustrated In Fig. 7A, 
the Stack 24 of the "receiving" Node 12R is unmodified and operates in the conventional 
manner to receive the Fragemented Packets 24F that have been fragmented into the 
optimum packet size. That is, the receiving Stack 24 reads the fragmentation headers 
of the IP packets in the conventional manner and as if the packets had been fragmented 
and the fragment headers written by the transmitting Stack 24 rather than by the NID 56 
operating at the direction of the Network Agent 54. The receiving Stack 24 then and 
therefore re-assembles the Fragmented Packets 24F into the Stack Packets 24P or into 
packets of the original size, and provides the packet data to the receiving Application 52. 
In this regard, it will be noted and understood that the Stack 24 of the Node 1 2P thereby 
does not require a separate fragment re-assembler operating to re-assemble the packets 
fragmented by the NID 56 as re-assembly of fragmented packets is a convention 
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operation performed by the normal and conventional defragmenting operations and 
mechanisms of the receiving Stack 24. which are well understood by those of ordinary 
skill In the arts. 

[188] In the instance of packets transmitted from the Passive Node 1 2P to the Adaptive 

Node 12A and through the Connection 18, such as in reply to one or more packets 
transmitted from the Node 12A, it will be understood by those of ordinary skill in the 
relevant arts that a Stack 24 of the from described herein will respond to packets 
received from another Node 12 by forming packets of the same size as has been 
received from the other Node 12. That is, during a given communication through a given 
Connection 18, the receiving Passive Node 12P will extract and store information 
regarding the size of the packets received from the transmitting Adaptive Node 12A and 
when transmitting packets back to the Node 12A will generate packets of the same size 
as it has received, which will therefore be of the optimum size for the current Connection 
18. For this reason, therefore, and because the Adaptive Node 12A solely determines 
the optimum packet size for the Connection 18 by operating In a single ended, echo 
mode, the Passive Node 12P of the pair may be completely conventional and does not 
require the presence of any of the components, operations or functions of the Packet 
Groomer 50. 

[189] While the invention has been particularly shown and described with reference to 

preferred embodiments of the apparatus and methods thereof, it will be also understood 
by those of ordinary skill in the art that various changes, variations and modifications in 
form, details and implementation may be made therein without departing from the spirit 
and scope of the invention as defined by the appended claims. Therefore, it is the object 
of the appended claims to cover all such variation and modifications of the invention as 
come within the true spirit and scope of the invention. 
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1 . A method for optimizing data pacl^et transmission througli a connection between 
a sending node and a receiving node in a data communication network, comprising the 
steps of : 

(a) periodically determining current network conditions in the connection 
between the sending node and the receiving node wherein the network conditions pertain 
to the latency and jitter of packet transmission between the sending node and receiving 
node, and 

(b) determining from the current network conditions an optimum packet size 
and an optimum inter-packet interval for transmission of packet data between the sending 
node and the receiving node. 

2. The method for optimizing data packet transmission through a connection between 
a sending node and a receiving node of claim 1 , wherein in step (b) further includes: 

(1 ) determining the optimum packet size and the optimum inter-packet interval 
for transmission of packet data between the sending node and the receiving node for a 
given amount and type of data to be communicated between the sending node and the 
receiving node. 

3. The method for optimizing data packet transmission through a connection between 
a sending node and a receiving node of claim 1 , wherein step (a) further includes the steps 
of: 

(a1) transmitting a sequence of monitor packets of a selected size from the 
sending node to the receiving node at a selected inter-packet interval, 

(a2) in the receiving node, reflecting the monitor packets from the receiving 
node to the sending node in the sequence in which the monitor packets are received at the 
sending node, and 

(a3) in the sending node and upon receiving the reflected monitor packets from 
the receiving node, determining network conditions in the connection between the sending 
node and the receiving node wherein the network conditions pertain to the latency and jitter 
of packet transmission between the sending node and receiving node for monitor packets 
of a known size and known inter-packet transmission interval. 
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4. The method for optimizing data packet transmission through a connection between 
a sending node and a receiving node of claim 3, wherein: 

each monitor packet includes 

a departure time representing a time the monitor packet was transmitted from 
the sending node, a packet size representing a size of the monitor packet and a packet 
number representing a numerical position of the monitor packet in the sequence of monitor 
packets. 

5. The method for optimizing data packet transmission through a connection between 
a sending node and a receiving node of claim 4, wherein: 

(1) the network conditions determined through the monitor packets include a 
maximum two way delay time for the transmission and reflection of a monitor packet, a 
minimum two way delay time for the transmission and reflection of a monitor packet, an 
average two way delay time for the monitor packets, an average jitter of the monitor packets, 
and a number of packets out of sequence. 

6. The method for optimizing data packet transmission through a connection between 
a sending node and a receiving node of claim 5, wherein the network conditions determined 
through the monitor packets further include: 

(2) a number of packets lost. 

7. The method for optimizing data packet transmission through a connection between 
a sending node and a receiving node of claim 3, wherein: 

(1 ) the network conditions determined through the monitor packets include an 
available bandwidth and a jitter of the connection. 

8. The method for optimizing data packet transmission through a connection between 
a sending node and a receiving node of claim 7, wherein: 

the network conditions determined through the monitor packets further include 
an average jitter, a maximum jitter and a minimum jitter. 

9. The method for optimizing data packet transmission through a connection between 
a sending node and a receiving node of claim 3, wherein: 
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the network conditions determined througli tiie monitor pacl^ets furtlier include 
a sequence in which the monitor packets are received at the receiving node. 

10. The method for optimizing data packet transmission through a connection 
between a sending node and a receiving node of claim 3, wherein: 

the network conditions determined through the monitor packets further include 
a number of monitor packets lost. 

1 1 . The method for optimizing data packet transmission through a connection 
between a sending node and a receiving node of claim 1 . further comprising the step of: 

(c) transmitting data packets from the sending node to the receiving node with 
packet sizes and at inter-packet intervals determined according to the network conditions. 

12. The method for optimizing data 'packet transmission through a connection 
between a sending node and a receiving node of claim 1 , further comprising the steps of: 

(a1 ) transmitting a sequence of monitor packets from the sending node to the 
receiving node, 

(a2) in the receiving node, reflecting the monitor packets from the receiving 
node to the sending node in the sequence in which the monitor packets are received at the 
sending node, and 

(a3) in the sending node and upon receiving the reflected monitor packets from 
the receiving node, determining network conditions in the connection between the sending 
node and the receiving node wherein the network conditions pertain to the latency and jitter 
of packet transmission between the sending node and receiving node for monitor packets 
of a known size and known inter-packet transmission interval, and 

(c) in the sending node and from the network conditions, determining an 
optimum packet size and an optimum inter-packet interval for transmitting packets from the 
sending node to the receiving node. 

13. The method for optimizing data packet transmission through a connection 
between a sending node and a receiving node of claim 12, further comprising the steps of: 

(d) in the receiving node, determining network conditions from the received 
monitor packets. 
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14. The method for optimizing data pacl<et transmission through a connection 
between the sending node and the receiving node of claim 13, further comprising the steps 
of: 

(e) in the receiving node, storing the network conditions in one or more 
condition records. 

15. The method for optimizing data paclcet transmission through a connection 
between a sending node and a receiving node of claim 13, further comprising the steps of: 

(d) returning the network conditions determined in the receiving node to the 
sending node, and 

(e) In the sending node, updating the optimum packet size and inter-packet 
interval using the network conditions determined In the receiving node. 

1 6. A method for optimizing data packet transmission through a connection between 
a sending node and a receiving node in a data communication network, comprising the 
steps of: 

(a) transmitting packets from the sending node to the receiving node, 

(b) in the receiving node and for each packet received from the sending node, 
generating and transmitting to the sending node an acknowledgment of receipt of the 
packet, and 

(c) in the sending node and upon receiving the acknowledgments of packets 
from the receiving node, determining network conditions in the connection between the 
sending node and the receiving node wherein the network conditions pertain to the latency 
and jitter of packet transmission between the sending node and receiving node for monitor 
packets of a known size and known inter-packet transmission interval, and 

(c) in the receiving node and from the network conditions, determining an 
optimum packet size and optimum inter-packet interval for transmission of data packets to 
the receiving node. 

17. A method for optimizing data packet transmission through a connection between 
a sending node and a receiving node in a data communication network, comprising the 
steps of: 
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(a) transmitting a sequence of data packets from the sending node to the 
receiving node, 

(b) in the receiving node, determining networl^ conditions from the received 

data packets 

(c) returning the network conditions determined in the receiving node to the 
sending node, and 

(d) in the sending node, using the network conditions determined in the 
receiving node to determine an optimum packet size and an optimum inter-packet interval 
for the transmission of data packets from the sending node to the receiving node. 

18. An adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network, comprising: 

(a) a sending node packet transfer engine and a receiving node packet transfer 
engine communicating through the connection for periodically determining current network 
conditions in the connection between the sending node and the receiving node wherein the 
network conditions pertain to the latency and jitter of packet transmission between the 
sending node and receiving node, and 

(b) a collector/controller for determining from the current network conditions 
an optimum packet size and an optimum inter-packet interval for transmission of packet data 
between the sending node and the receiving node. 

1 9. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 18, wherein: 

(1) the collector/controller determines the optimum packet size and the 
optimum inter-packet interval for transmission of packet data between the sending node and 
the receiving node for a given amount and type of data to be communicated between the 
sending node and the receiving node. 
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20. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 18, wherein: 

(a1) the sending node packet transfer engine is responsive to the 
collector/controller for transmitting a sequence of monitor packets of a selected size from 
the sending node to the receiving node at a selected inter-packet interval, 

(a2) the receiving node packet transfer engine is responsive to monitor packets 
received from the sending node for reflecting the monitor packets from the receiving node 
to the sending node in the sequence in which the monitor packets are received at the 
sending node, and 

(a3) the sending node packet transfer engine Is responsive to reflected monitor 
packets received from the receiving node for determining network conditions in the 
connection between the sending node and the receiving node wherein the network 
conditions pertain to the latency and jitter of packet transmission between the sending node 
and receiving node for monitor packets of a known size and known inter-packet transmission 
interval. 

21 . The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 20, wherein: 

each monitor pacl<et includes 

a departure time representing a time the monitor packet was transmitted 
from the sending node, a packet size representing a size of the monitor packet and a packet 
number representing a numerical position of the monitor packet in the sequence of monitor 
packets. 

22. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 21 , wherein: 

(1) the network conditions determined through the monitor packets include a 
maximum two way delay time for the transmission and reflection of a monitor packet, a 



wo 02/101513 



PCTAJS02/18864 



-79- 

minimum two way delay time for the transmission and reflection of a monitor packet, an 
average two way delay time for the monitor packets, an average jitter of the monitor packets, 
and a number of packets out of sequence. 

23. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 22, wherein the network conditions determined through the monitor packets 
further include: 

(2) a number of packets lost. 

24. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 20, wherein: 

(1 ) the network conditions determined through the monitor packets include an 
available bandwidth and a jitter of the connection. 

25. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 24, wherein: 

the network conditions determined through the monitor packets further Include 
an average jitter, a maximum jitter and a minimum jitter. 

26. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 20, wherein: 

the network conditions determined through the monitor packets further include 
a sequence in which the monitor packets are received at the receiving node. 

27. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 20, wherein: 

the network conditions determined through the monitor packets further include 
a number of monitor packets lost. 
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28. The adaptive packet mechanism for optimizing data pacl<et transmission through 
a connection between a sending node and a receiving node in a data communication 
networl< of claim 18, wherein: 

(c) the sending node packet transfer engine is responsive to the optimum 
packet size and inter-packet interval determined by the collector/controller for transmitting 
data packets from the sending node to the receiving node with packet sizes and at inter- 
packet intervals determined according to the network conditions. 

29. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 18. wherein: 

(d) the receiving node packet transfer engine is responsive to monitor packets 
received from the sending node for determining network conditions from the received 
monitor packets. 

30. The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 29, wherein: 

(e) the receiving node packet transfer engine is responsive to the monitor 
packets received from the sending node for storing the network conditions in one or more 
condition records. 

31 . The adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network of claim 30, wherein: 

(e) the receiving node packet transfer engine is responsive to the monitor 
packets received from the sending node for providing the network conditions determined in 
the receiving node to the collector/controller, and 

(f) the collector/controller is responsive to the network conditions determined 
in the receiving node for updating the optimum packet size and inter-packet interval using 
the network conditions determined in the receiving node. 



wo 02/101513 PCT/US02/18864 



-81- 

32. An adaptive packet mechanism for optimizing data packet transmission tlirough 
a connection between a sending node and a receiving node in a data communication 
network, comprising: 

(a) a sending node packet transfer engine for transmitting packets from the 
sending node to the receiving node, 

(b) a receiving node packet acknowledgment mechanism responsive to each 
packet received in the receiving node from the sending node for generating and transmitting 
to the sending node packet transfer engine an acknowledgment of receipt of the packet, 

(c) the sending node packet transfer engine being responsive to the 
acknowledgments of packets from the receiving node for determining network conditions in 
the connection between the sending node and the receiving node wherein the network 
conditions pertain to the latency and jitter of packet transmission between the sending node 
and receiving node for monitor packets of a known size and known inter-packet transmission 
interval, and 

(c) a collector/controller responsive to the network conditions determining an 
optimum packet size and optimum inter-packet interval for transmission of data packets to 
the receiving node. 

33. An adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a data communication 
network, comprising: 

(a) a sending node packet transfer engine for transmitting a sequence of data 
packets from the sending node to the receiving node, 

(b) a receiving node packet transfer engine for determining network conditions 
from the received data packets, and 

(d) a collector/controller responsive to the network conditions determined by 
the receiving node packet transfer engine for determining an optimum packet size and an 
optimum inter-packet interval for the transmission of data packets from the sending node 
to the receiving node. 
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34. A method for optimizing data packet transmission through a connection between 
a sending node and a receiving node in a wireless data communication networic, comprising 
the steps of: 

(a) transmitting paclcets from the sending node to the receiving node, 

(b) in the receiving node and for each pacl^et received from the sending node, 
generating and transmitting to the sending node an aclcnowiedgment of receipt of the 
paclcet, and 

(c) in the sending node, 

(c1 ) upon receiving the acknowiedgments of packets from the receiving 
node, determining network conditions in the connection between the sending node and the 
receiving node, including connection latency and jitter for packets of a known size and 
known inter-packet transmission interval, and 

(c2) determining from the network conditions an optimum packet size 
and optimum inter-packet interval for transmission of data packets through the connection, 

(d) in the sending node network protocol stack, 

(d1) intercepting each packet to be transmitted to the receiving node, 
(d2) fragmenting the packets into fragmented packets of the optimum 

packet size, modifying fragmentation fields of packet headers to reflect a fragmented packet 

size, and 

(d3) transmitting the fragmented packets to the receiving node, and 

(e) in the receiving node, defragmenting the fragmented packets into packets 
according to the fragmentation fields, 

35. The method of claim 34 for optimizing data packet transmission through a 
connection between a sending node and a receiving node in a wireless data communication 
network, further comprising the steps of: 

(f) in the receiving node network protocol stack, 

(f1) structuring each packet to be transmitted to the sending node into 
packets of the optimum packet size as determined from fragmented packets received from 
the sending node, and 
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(f2) transmitting the receiving node packets to the sending node. 

36. The method of claim 34 for optimizing data packet transmission through a 
connection between a sending node and a receiving node in a wireless data communication 
network, wherein the wireless network is an 802.1 1 or similar network. 

37. An adaptive packet mechanism for optimizing data packet transmission through 
a connection between a sending node and a receiving node in a wireless data 
communication network, comprising: 

(a) a sending node and a receiving node, each including an a network protocol 
stack, a device driver connected from the protocol stack and a network interface connected 
from the device driver and to a connection for communicating packets from the sending 
node to the receiving node, and 

(b) in the sending node, a network intermediate driver residing between the 
network protocol stack and the device driver for 

(b1) determining, from packets transmitted to the receiving node and 
echo acknowledgments received from the receiving node in response to each transmitted 
packet, network conditions in the connection between the sending node and the receiving 
node, including connection latency and jitter, for packets of a known size and known inter- 
packet transmission interval, 

(b2) intercepting each packet to be transmitted to the receiving node, 

and 

(b3) fragmenting the packets into fragmented packets of the optimum 
packet size, modifying fragmentation fields of packet headers to reflect a fragmented packet 
size, and 

(b4) transmitting the fragmented packets to the receiving node. 

38. The adaptive packet mechanism of claim 37 for optimizing data packet 
transmission through a connection between a sending node and a receiving node in a 
wireless data communication network, wherein: 
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(c1) the network protocol stack is responsive to eacli received 
fragmented packet for defragmenting the fragmented packets into packets according to the 
fragmentation fields. 

39. The adaptive packet mechanism of claim 38 for optimizing data packet 
transmission through a connection between a sending node and a receiving node in a 
wireless data communication network, wherein: 

(c1 ) the network protocol stack is responsive to the received fragmented 
packets for fragmented packets to be transmitted to the sending node into fragmented 
packets of the optimum packet size, including changing the fragmentation fields of the 
packet headers accordingly. 

40. The adaptive packet mechanism of claim 37 for optimizing data packet 
transmission through a connection between a sending node and a receiving node in a 
wireless data communication network, wherein the network intermediate driver comprises: 

a packet transfer engine connected between the network protocol stack and 
the device driver for 

determining the network conditions in the connection, and 
fragmenting the packets into corresponding fragmented packets, and 
a collector/controller associated with the packet transfer engine and responsive 
to the network conditions determining an optimum packet size and optimum inter-packet 
interval for transmission of packets through the network. 
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Test Schedule Script File 38 



Header Name 


Value 


Description 








Test Type 


Net Condition 


Records tests of 10 28 bytes packet transmission at a 
specified inter-packet delay. 




Data Transfer 


Records test of packets with a forced payload size or 
forced packet count at a specified inter-packet delay. 


IP Protocol 


UDP 


UDP protocol provides minimal transmission delay' 
because it excludes the connection setup process, flow 
control and retransmission ~ no error checking 
performance. 


Send Mode 


TXRX 


Net Condition test send mode 


Send IP Address 




Sender's IP address 


Send IP Port 


-1 


Negative number indicates IP stack chooses the 
sending port 


Send Embed 
Of&et Sec 




Padding 








Recv Mode 


Echo 


Net Condition receive mode ~ test always functions in 
a loop 




Recv 


Data Transfer receive mode — data is transmitted one 
way. 


Rec IP Address 




Receiver's IP address 


Recv IP Port 


5551 


Net Condition test port ID 




5552 


Data Transfer test port ID 


Recv Embed 
Offset Sec 




Padding 


Force Payload 
Size 


28 


Net Condition test packet sizes 




10-1400 


Data Transfer test packet sizes 


Force Packet 
Count 


10-100 


Data Transfer test packet breakdown 


Inter-packet 
Delay ms 


arbitrary 


Inter-packet delay for Net Condition and Data 
Transfer tests are detennined by TSSF. 


Loop and Restart 


Net Condition 


Yes - data transfer is constantly repeated 




Data Transfer 


No - data transfer is not repeated 



FIG.6B 
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NETWORK CONDITION RECORD 40R 

44A - packet number - the number of packets that were sent for the whole data 
44B - payload - the size of a sent packet in bytes 

44C - totalbytes - the total aggregate bytes of the combined payloads that represent the total data 

44D - Interpacketdelay_ins - the time spacing of packets sent (in ms) 

44E - elapsedtime_sec - the duration the listener ran 

44F - packetsIN - the # of packets received IN by listener per TRANSFER 

44G - packetsOUT - the # of packets sent OUT by listener per TRANSFER 

44H - bytesIN - the bytes received in per transfer 

441 - bytesOUT - the bytes sent out per transfer 

44G - bytesIN/sec - the rate of bytes 

44H- bytesOUT/sec- the rate of bytes OUT 

441 - packetsIN/sec - the rate of packects IN 

44 J - packetsOUT/sec - the rate of packets OUT 

44K - numreads - the number of attempted reads from socket 

44L - numreadsblocked - the nimiber of reads to socket having nothing to read 

44M - numkrnlreaderrs - the number of read errors (e.g. MAC layer failure; * 

helpful to show wireless network blackout conditions) 
44N - numwrites - the number of attempted writes to socket 

440 " numwritesfolocked - the number of writes to socket xmable to send out (shows 
that network is clogged; IP stack unable to accept more) 

44P - numkemelwriteerros - the number of write errors (see note on MAC layer) 

44Q - numkeraelunspecifiederrors - the number of unknown errors 

44R - jitter avg sec - the avg jitter 

44S - jitter max sec - the max jitter 

44T - jitter min sec - the min jitter 

44U - packet loss - packets not received (the packet loss) 

44V - % loss - percentage of loss out of total 

44W * pass sequence - # of packets in sequence (by checking the incremental 
sequence ID on each packet Next packet ID is current 
ID+ 1) 

44X - fail sequence - # of packets not in precise sequence 

44Y - % out of sequence - percentage of packets out of sequence out of total 

net condition 2- way delay average - the two-way, round trip packet delay 

as measured in seconds, to microsecond precision. The average value across all packets received 

during the specific data transfer and its time frame. 

44Z - net condition 2-way delay max - the max of the delay value for the network condition 
44AA- net condition 2-way delay min - the min of the delay value for the network condition 
44AB -net condition jitter avg sec - the average jitter for the network condition 
44AC -trendupordown - the change of the delay during the test 
(+ means the delay was increasing during the test, - means 
it was decreasing 

FIG. 6C 
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